Skip to main content

I have a csv file looking as below





ATT1
ATT2
ATT3
New Attribute


Fri Jun 24 08:01:00 2016
1.46676E+12
A



Sat Jun 25 08:01:00 2016
1.46684E+12
A



Thu Jul 07 08:01:00 2016
1.46788E+12
A



Fri Jul 08 08:01:00 2016
1.46796E+12
A



Sat Jul 09 08:01:00 2016
1.46805E+12
A



Sun Jul 10 08:01:00 2016
1.46814E+12
B

 




Mon Jul 11 08:01:00 2016
1.46822E+12
B

 




Sat Sep 24 08:01:00 2016
1.4747E+12
B

 




Sun Sep 25 08:01:00 2016
1.47479E+12
B

 

I want to set the "New Attribute" to 'Yes' based on the "ATT3" value of the last row.

Or i want to filter the records based on the ATT3 value of the last row.

Hi!

 

I wonder if using Pointclouds could have a performance-impact positively/negatively here ?

For instance like the screenshot below: You can get the last value in the text-file with PointCloud-operations. (Don't think you can do the actual filtering without changing the component to some Integer though. Would be cool though.).

 

 

Now - this if the case really is the last record in the file.

@daleatsafe , @xiaomengatsafe?

It is true that you can get the last record of a point cloud super fast. And if you ensured you'd get one point cloud per input file (which you do), then this would be an even better way to get the global variables set on the first pass. You still would need to do the second pass to actually set the values of each record based on the last one -- and that would be best done using the traditional CSV reader.

 

 

Note that if we made the Sampler understand our new feature table technology AND if we had a way to get the LAST records from the Sampler, then this becomes as fast using non-pointcloud approaches.

 

 

(In fact, the feature tables are inspired by the speed that FME's point cloud subsystem exhibits).

 

 


Hi, @sobanmughal and @1spatialdave I'm happy to report: as of Build 18187 in the current 2018 Beta, Sampler has a new option to return the "Last N Features". This might be useful for workflow like this one, in the future. Thanks!


Hi, @sobanmughal and @1spatialdave I'm happy to report: as of Build 18187 in the current 2018 Beta, Sampler has a new option to return the "Last N Features". This might be useful for workflow like this one, in the future. Thanks!

Good to hear. Thanks for the enhancement.

 

 


Reply