Data

Looking to share experiences with AWS Redshift and now with the new spatial support if you have tackled that yet.

Has anyone ever tried to create texture atlases in FME?  I'm thinking about trying to try this, however, I don't want to recreate the wheel or start a process which is just not worth it (performance-wise).  If anyone has had a go at this I would really appreciate any tips of comments  Thanks in advance!  

Hey there, I have a few workspaces that make use of the Esri File Geodatabases readers and writers. Processing a huge amount of data comes with some issues. In the past i had noticed a huge slowdown of my performance once i hit the last few transformers in the line. Last week i noticed the log line that comes up during the negative performance switch.  The line states: Optimizing Memory Usage (something something)Ram usage stabilizes from ~2,7 GB down to about 2,4GB and does not rise anymore. I have more than 10GB of available space left but it will not use more, probably because its the 32bit version. After that point, i will only be able to process around 5-10 objects a second! This is extremely slow if compared to before that point, which was around the thousands a second or even more. I am looking for a solution to this issue and came up with the following idea:If i export the data from the file geodatabase in FME 32bit to something supported by FME 64bit, do the processing on that

I'm attempting to write to a version in an ArcGIS SDE database with a SQL Server Backend. I have created a version in the database and I want FME to write directly to it. I'm selecting the "Override Version" box. However, when I click the button to load the versions in the writer, I get the following error:The log shows this:Creating reader for format: Esri Geodatabase (ArcSDE Geodb)Trying to find a DYNAMIC plugin for reader named `GEODATABASE_SDE'FME API version of module 'GEODATABASE_SDE' matches current internal version (3.8 20190820)Unable to open the Geodatabase reader because the 'DATASET' keyword was not foundA fatal error has occurred. Check the logfile above for detailsThis error only seems to occur for me in 2019.2. I have tried it in 2018.1 and I can successfully read the versions that exist in the database. Is this a bug in 2019.2? What could be causing this error?

I have two featureWriter fed by same feature. I want to write on a PostgreSQL database. I specify one with a schemas (Table Qualifier) and the other not.After that I want to use the result who was write to manage my foreign keys. The summary is the same (2 features written). Is it normal that when I specify a table qualifier, any of my feature can't be used after the FeatureWriter ?

Hi, the doc for Trimble Sketchup says version 2015 or earlier is supported, so 2016 and later are not supported?

Good day I have an image dataset which I would like to do content conversion. As it stands y=-y, x=-x. How do I go about it to make x=x, y=y?It's my first time to use FME. I have tried to locate the scaler function but couldn't find it?

I need to relate text values (annotations) to lines. In the example bellow, there are 3 lines and 2 annotations. The longest line (two segments) should get value "PEd100" and the other one should get PE32. Annotations aren't related to lines by common attribute, just placed near the lines.In this case both geometry and annotations are on the same layer, but it's not always the case. Any ideas? 

It appears I now need to add all the _match_id(s) with their correlating unique _line_id by length.. Any tips on how to do this?  Thanks in advance,  Fred

So, I've read some of the earlier responses to similar questions but I don't know that I gleaned a definitive answer for this.The setup is in Oracle there are ArcGIS generated views of Versioned spatial data tables Eg. TableName_EVW and that View has SHAPE as an ST_Geometry (instead of Oracle's own SDO_Geometry).Yes, I know I can read this with the SDE Reader, but I need to get around SDE at the moment as it is misbehaving in the Covid world of VPNs whereas direct connection via native Oracle works MUCH better.So:All the FME Oracle Readers tried recognise the SHAPE field, but the Reader log tells me that it is skipping over the SHAPE field (presumably because it isn't SDO_Geometry data type)........despite that the log also tells me it recognises the Data Type as ST_Geometry. So the Readers by default return the non-spatial fields, and no geometries because it skips over the SHAPE field.SQLCreator/SQLExecutor methods don't work that well either. Same result even

Using FME version 2019.2.3.1 it appears that if the MITAB writer format is selected within a FeatureWriter that non-standard CRS's default to an arbitrary "LL" CRS based on WGS84.When tested not using the FeatureWriter this doesn't appear to occur. The FeatureWriter does not allow setting of output Coord. System from an attribute therefore I am required to rely on "Same as source". I do have a MITAB workspace resource but again I cannot set the Coord. System as a Parameter and only as an Attribute in my use case.Is this a limitation on the FeatureWriter or on the MITAB writer and MapInfo format itself when it comes to very new Projections?

This some détails.Our Bloc "Orientage Crosse" has an custom orientation (Print Screen 1)Print Screen 1The dwg source has some block "Orientage Crosse" with a rotation and Angle1 (Print Screen 2 to Print Screen 6). In FME with the readers, the name of the block it's not "Orientage Crosse" but a specifi name like *U365, *U400,... (cf Print Screen 7 to Print Screen 10).The oriention and the Angle1 don't have the expected values. If my block hasn't angle1 like in print Screen 1, we don't have the problem. Someone can help me?  Print Screen 2 Print Screen 3Print Screen 4Print Screen 5Print Screen 6Print Screen 7Print Screen 8Print Screen 9Print Screen 10 

Can gINT (.gpj) files be read into FME? If not, are there workarounds? If not, are there any future plans to add it ?

Since upgrading fme workbench to 2020.0, when I click on a feature writer with an excel format, it takes 30 seconds for the feature writer to open. Making any changes after it opens from there is painfully slow. Windows (windows 10) resource monitor shows fme desktop as being unresponsive for a bit while it's loading. Has anybody else experienced this?

Does anyone know how to create a multi-layer KMZ/KML with a dynamic schema?  Whenever I try It seems to only properly create the first layer with the correct schema and layer - everything else just becomes a placemark?  I want to use the Schema From Schema Feature option in the output feature type. Has anyone got this working?  If I create layers manually then FME will create multiple layers and schema definitions in the output doc.kml. If I use dynamic then I only get the first layer defined.   I can merge all feature into a single layer for the file and the result looks great in Google Earth but the issue is there is one Schema in the output doc so when reading in with FME there is only one layer and one mega Schema.     

I have some tables in a spatialite database, and I want to truncate the tables.It seems there is no TRUNCATE command in sqlite/spatialite so I've used 'DELETE FROM <my table>' in SQL Exector.I get a rejected feature with the following log message (in red text)."SPATIALITE reader: In ExecuteSQL(): sqlite3_step(DELETE FROM boundaries): SQL logic error or missing databaseSPATIALITE reader: Unable to execute SQL statement 'DELETE FROM boundaries'SPATIALITE reader: Unable to read feature type '__fme_execute_sql_results__'A fatal error has occurred. Check the logfile above for details."I can execute the same command using SQLExecutor on an Oracle database, so the issue seems to be with the spatiaLite reader/writer format.I've also tried 'DROP TABLE <my table>', but it returns the same rejection message.Reading some documentation online, it seems you cannot delete on views in sqlite/spatialite, but I'm trying to access a tabl

I have various Workbenches which have FFS readers as input. In couple of WBs, there is a single FFS reader as input, whereas in few WBs, there are multiple FFS readers. As these WBs are required to be executed across various regions, some of the regions do not have one or the other FFS file. These WBs are executed using workspace runners. Before every workspace runner, i have place FileExistenceChecker transformer to check for existence of FFS file in that folder. If the FFS file exists, it is directed to that runner, else it skips and goes to the next FileExistenceChecker transformer. I have a problem with WBs having multiple FFS readers, as even if a single FFS file is not present, the FME stops midway. Is there a method to disable that particular FFS reader from the workspace runner, after it checks that the FFS file is not present in the folder ? OR any other workaround to bypass that FFS reader?

I am attempting to read from an existing layer on arcgis online and check it against a layer in FGDB using change detector and update the same layer arcgis online if there are any changes made. They are all identical layers in terms of geometry. The only thing that will change is an attribute name in the table. So far it updates the data table correctly but it erases the geometry on AGOL.

Hi.I am wanting to export a point layer (GEODATABASE FILE) to a .dwg using the pre-reconfigured block template symbols. I have attempted using the DWGStyler but it will not pick up the templates symbols for some reason and just places a point. I have tried following https://community.safe.com/s/question/0D54Q000080hglVSAQ/replace-point-with-symbol-from-a-dwg but there is not quite enough detail on how to go about it. Can someone please provide the parameters that I need to fill to get the symbol to a dwg file.Thanks. 

We are looking for a simple FME code to convert shape files to Smallworld XML with relationship as per given sample XML file & the input shape file. The detail query is attached.Markatsafe had given a great answer before on other question to us.

Read excel from sharepoint I try to read an excel file stored in company sharepoint site but no successI need to ask to IT some special rights ?any idea ? thx Francesco

Is there any way that a FME workbench could be set up to take several thousand documents from a directory folder and load them into MS Sharepoint?

I am creating a query from Snowflake and want to write the results to a Microsoft Access database. The job fails when writing to Access with the following error: Microsoft Access Writer: Writer mode for feature type `tblDaily' requires key column specification, or a where clause specification. I have searched on line and can't find a good example of how to correct this error. Can you point me in the right direction? Thanks!

Hi. I have a bunch of xlsx files that are created daily that need to be loaded to PW. They are all in the same directory so I used a TestFilter to separate them out. I can't select the 'File' option on the PW Connector b/c the date changes everyday and the Folder option won't work either. I did have some surface success with Attribute, but the files are corrupt when they land in PW. I am a bit of a newbie, so any help would be appreciated.

Hi FME-users,I have a model in FME 2015.1 reading dynamically from a file gDB.If I ran the model locally, everything works fine. However, if I run the model on FME Server, I get following error:Geodatabase Error (-2147024893): The system cannot find the path specified.The path is provided by a published parameter which I'm passing to the model.Can anyone tell me more about this error?