Skip to main content
Solved

Big CSV to Raster files

  • November 20, 2013
  • 1 reply
  • 43 views
R
Hello guys,

 

 

I have a big CSV file ( 1.3 Go) as an output of a modeling software. This CSV has 2 fields for Lat/Long and 145 more fields, each for a climate variable. I need to convert each variable in a raster, so 145 rasters, with a 500meters resolution (same as input resolution actually)

 

 

I tried with the 3D point replacer wich seems to work, but I have problems to set the NumericRasterizer and the ouput is just full of NoDataValues.

 

 

R is running out of memory while FME seems to do the job...good point !

 

 

Thanks !

Best answer by sigtill

Do you have the first 10 lines of this CSV-file? Or can you recreate an example? I would first just read the Lat/long column and convert to coordinates and include the linenumber and save as FFS.

 

 

I would then create a list of the 145 fields and somehow merge this with the FFS-file and produce 145 different output rasters.

 

 

Show you a small demo file (10 lines with all 145 attributes) and it will be easier to help
View original
Did this help you find an answer to your question?
This post is closed to further activity.
It may be a question with a best answer, an implemented idea, or just a post needing no comment.
If you have a follow-up or related question, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

1 reply

sigtill
Contributor
Forum|alt.badge.img+24
  • sigtillContributor
  • Contributor
  • Best Answer
  • February 5, 2014
Do you have the first 10 lines of this CSV-file? Or can you recreate an example? I would first just read the Lat/long column and convert to coordinates and include the linenumber and save as FFS.

 

 

I would then create a list of the 145 fields and somehow merge this with the FFS-file and produce 145 different output rasters.

 

 

Show you a small demo file (10 lines with all 145 attributes) and it will be easier to help
The real SigTill

Most helpful members this week

Community Stats

30,846
Posts
116,937
Replies
38,670
Members
Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.