Skip to main content
Solved

Big CSV to Raster files

  • November 20, 2013
  • 1 reply
  • 61 views
R
Hello guys,

 

 

I have a big CSV file ( 1.3 Go) as an output of a modeling software. This CSV has 2 fields for Lat/Long and 145 more fields, each for a climate variable. I need to convert each variable in a raster, so 145 rasters, with a 500meters resolution (same as input resolution actually)

 

 

I tried with the 3D point replacer wich seems to work, but I have problems to set the NumericRasterizer and the ouput is just full of NoDataValues.

 

 

R is running out of memory while FME seems to do the job...good point !

 

 

Thanks !

Best answer by sigtill

Do you have the first 10 lines of this CSV-file? Or can you recreate an example? I would first just read the Lat/long column and convert to coordinates and include the linenumber and save as FFS.

 

 

I would then create a list of the 145 fields and somehow merge this with the FFS-file and produce 145 different output rasters.

 

 

Show you a small demo file (10 lines with all 145 attributes) and it will be easier to help
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

1 reply

sigtill
Supporter
Forum|alt.badge.img+25
  • sigtillSupporter
  • Supporter
  • Best Answer
  • February 5, 2014
Do you have the first 10 lines of this CSV-file? Or can you recreate an example? I would first just read the Lat/long column and convert to coordinates and include the linenumber and save as FFS.

 

 

I would then create a list of the 145 fields and somehow merge this with the FFS-file and produce 145 different output rasters.

 

 

Show you a small demo file (10 lines with all 145 attributes) and it will be easier to help
The real SigTill

Community Stats

32,154
Posts
122,043
Replies
39,812
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.