Skip to main content
Solved

Meaning of .fts files written with FFS writer.


kalbert
Supporter
Forum|alt.badge.img+14

HI,

For test purposes I'm reading from two ESRI FileGDB with a FFS writer (no further transformations).

Now I recognized that the FFS writer wrote an additional .fts file. It's binary and larger than the.ffs (e.g. 5MB vs 11kb).

What is the meaning of .fts files?

thanks, Klaus

(FME Server 2017.1)

Best answer by fmelizard

".fts" is the "FME Feature Table" store. This is a more compact, faster way we deal with data that is known to share a schema across rows. The File Geodatabase (API) reader was an early convert to this new method of handling data. So I'm not surprised you saw what you're seeing. And the .fts does carry by far the bulk of the data, so that is why there is the size difference.

Right now CSV and MapInfo Extended are the other two readers that work in this way and would result in .fts files when written to FFS. An increasing # of transformers are being changed to either work upon or output data using this new technique, but all any user should notice is that things just work faster.

View original
Did this help you find an answer to your question?

7 replies

kalbert
Supporter
Forum|alt.badge.img+14
  • Author
  • Supporter
  • March 29, 2018
Sorry I'm not reading with the FFS writer. I'm reading with a File GDB API reader and writing FFS.

 

 


fmelizard
Safer
Forum|alt.badge.img+18
  • Safer
  • Best Answer
  • March 30, 2018

".fts" is the "FME Feature Table" store. This is a more compact, faster way we deal with data that is known to share a schema across rows. The File Geodatabase (API) reader was an early convert to this new method of handling data. So I'm not surprised you saw what you're seeing. And the .fts does carry by far the bulk of the data, so that is why there is the size difference.

Right now CSV and MapInfo Extended are the other two readers that work in this way and would result in .fts files when written to FFS. An increasing # of transformers are being changed to either work upon or output data using this new technique, but all any user should notice is that things just work faster.


danilo_fme
Evangelist
Forum|alt.badge.img+44
  • Evangelist
  • March 31, 2018
fmelizard wrote:

".fts" is the "FME Feature Table" store. This is a more compact, faster way we deal with data that is known to share a schema across rows. The File Geodatabase (API) reader was an early convert to this new method of handling data. So I'm not surprised you saw what you're seeing. And the .fts does carry by far the bulk of the data, so that is why there is the size difference.

Right now CSV and MapInfo Extended are the other two readers that work in this way and would result in .fts files when written to FFS. An increasing # of transformers are being changed to either work upon or output data using this new technique, but all any user should notice is that things just work faster.

I liked so much this Information :)

 

 


kalbert
Supporter
Forum|alt.badge.img+14
  • Author
  • Supporter
  • April 10, 2018

Thanks for explanation. Do I understand correctly that the Geodatabase API reader detects the different "flavours" of File GDBs automatically and writes . ffs if the GDB does not share a schema across rows and .ffs plus .fts if the GDB shares a schema across rows?

This would explain why some of my GDBs result in ffs and others in ffs/fts.


ostoja
Contributor
Forum|alt.badge.img+2
  • Contributor
  • November 21, 2019
fmelizard wrote:

".fts" is the "FME Feature Table" store. This is a more compact, faster way we deal with data that is known to share a schema across rows. The File Geodatabase (API) reader was an early convert to this new method of handling data. So I'm not surprised you saw what you're seeing. And the .fts does carry by far the bulk of the data, so that is why there is the size difference.

Right now CSV and MapInfo Extended are the other two readers that work in this way and would result in .fts files when written to FFS. An increasing # of transformers are being changed to either work upon or output data using this new technique, but all any user should notice is that things just work faster.

Hi @daleatsafe,

I noted that more and more writers are producing mentioned .fts files.

Do we have some kind of option setting where we can choose to continue producing old .ffs format or readers are moving to .fts automatically?


mark2atsafe
Safer
Forum|alt.badge.img+44
  • Safer
  • November 22, 2019
ostoja wrote:

Hi @daleatsafe,

I noted that more and more writers are producing mentioned .fts files.

Do we have some kind of option setting where we can choose to continue producing old .ffs format or readers are moving to .fts automatically?

I don't think other writers should be producing fts files, only the FFS writer. But more and more writers are supporting feature tables (aka bulk mode) and that technique is here to stay.

There is no way to force the FFS writer to write older versions. The version of FFS changes all the time and it would be very hard for us to implement that. However, if the problem is having multiple files, can I suggest you write to a zip file instead? For example, if I write to mydataset.zip, then it will contain both mydataset.ffs and mydataset.fts (and other FFS files, of which there are a few, such as frs for raster).


ostoja
Contributor
Forum|alt.badge.img+2
  • Contributor
  • November 26, 2019
mark2atsafe wrote:

I don't think other writers should be producing fts files, only the FFS writer. But more and more writers are supporting feature tables (aka bulk mode) and that technique is here to stay.

There is no way to force the FFS writer to write older versions. The version of FFS changes all the time and it would be very hard for us to implement that. However, if the problem is having multiple files, can I suggest you write to a zip file instead? For example, if I write to mydataset.zip, then it will contain both mydataset.ffs and mydataset.fts (and other FFS files, of which there are a few, such as frs for raster).

Hi @mark2atsafe,

yes, indeed it is FFS writer. I didn't understood that fts files are result of new bulk mode approach, but now it's clear. Having multiple files is no issues. I am ready to sacrifice everything for best performance :)


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings