Skip to main content
Question

which format is the best performance to read by FME Desktop ?

  • April 8, 2022
  • 5 replies
  • 93 views

gogopotter90
Contributor
Forum|alt.badge.img+14

 

my department should provide me with data to read by FME but they requires me to choose the format file for the data that FME could read and works at higher performance as excel ,csv ,sqlite ,...etc . other formats are available also .

which format from your experiences will be best performance than others ,why ?

FME Desktop 2020

Thanks in advance.

5 replies

nielsgerrits
VIP
Forum|alt.badge.img+60
  • 2938 replies
  • April 8, 2022

I think this depends on the context but I would prefer a lot of datatypes above Excel . This is because Excel is a mix of a kind of database file but with too much freedom for the user with slightly different column names, sheet names, column names on different rows. I would prefer a real database format like postgres / postgis. But context matters.


gogopotter90
Contributor
Forum|alt.badge.img+14
  • Author
  • Contributor
  • 239 replies
  • April 8, 2022

I think this depends on the context but I would prefer a lot of datatypes above Excel . This is because Excel is a mix of a kind of database file but with too much freedom for the user with slightly different column names, sheet names, column names on different rows. I would prefer a real database format like postgres / postgis. But context matters.

thanks for reply and your opinion but when you compare between formats ,what should u look for ?

and please ,what is your opinion about sqlite ,will be good ?

 


hkingsbury
Celebrity
Forum|alt.badge.img+63
  • Celebrity
  • 1625 replies
  • April 10, 2022

I quite like SQLite as it is a single file, has indexes, has compression etc. But one downside is that it requires more 'specialised' software to view. Something like Excel is also good as @nielsgerrits​ alluded to.

It is really context specific, in one scenario Excel may be best, another SQLite might be more appropriate, or GDB, CSV etc


Forum|alt.badge.img+2
  • 1891 replies
  • April 12, 2022

@gogopotter90​ For simplicity and speed I think CSV will win


gogopotter90
Contributor
Forum|alt.badge.img+14
  • Author
  • Contributor
  • 239 replies
  • April 13, 2022

Thanks all for all information , i will work on CSV file .