Using readers and writers to extract and load data.
Recently active
Hello everyone, I'm working on creating a Geopackage, and I've added a new table (feature type) to indicate the relationship between several other tables. How can I add features to this table without taking the original feature type or feature from the reader.
I have a dynamic workbench which reads KML and/or KMZ files (OGC/Google KML Reader with selected Multiple Files *.kml and *.kmz) do some translation and writes output features to Geodatabase.Workbench does all the translation and writes output Geodatabase, but when I run this workbench with only KML files (no KMZ files in input folder) I get an error message: KML: Cannot open dataset `G:\\path\\**\\*.kmz'KML: Error initializing readerWhen I run this workbench only with KMZ files (no KML files in input folder) I get an error message: KML: Cannot open dataset `G:\\path\\**\\*.kml'KML: Error initializing readerWhen I run this workbench with both KML and KMZ files in the input folder I don't get the error message. Can you give me some tips on how to work around this problem so that the error message does not show up in the log? Or can it show up as a warning rather than an error? It is confusing for the Workbench user when they get the error message, and the workbench actually
Hello everybody. The problem is the following. From a httpCaller and a featureReader I open a GTFS, but some attributes (stop_sequence in stopTimes.txt and end_date in calendar.txt) appear as missing. However, if I examine the downloaded zip with a text editor, the missing attributes appear with value, but if I open the downloaded with FME with a reader it doesn't...I tried attributeExposer, but it doesn't work. Any suggestions? Thank you so much! Pol
When attempting to read features from Salesforce via FME Server (2021.2) the job fails after warning:WARN |MULTI_READER(MULTI_READER): Skipping to next ReaderERROR |A fatal error has occurred. Check the logfile above for details The workspace runs to completion on FME Desktop (2021.2) and reads data successfully. Troubleshooting hasn't provided any further information or progress. Is there a reason that the skipping occurs on FME Server?
Need Help I have been using FME Inspector to read an IFC file. Inside the IFC file, there are IfcGeographicElement features (DTM surface). My question is, why doesn't FME display the shape of the object?I noticed in the FME the number of vertices is zero, but when I opened it in Open IFC Viewer, I can see the IfcGeographicElement object, and there are vertex values 15515.Attached herewith are screenshots of both applications views.
I am trying to map a geopackage file to another geopackage file (same format). Why is the geometry in the reader I input in 3D format, but the geometry produced by the writer is only in 2D format? Please help.
Hello everyone,I have produced a dataset in oracle. I can't display those data in ArcMap because of the issue "the number of points is less than required for feature".After reading several posts, I now understand that the issue come from the esri grid (toleand and precision) which snap point and this snapping process when displaying data in esri create some geometric issues like self-intersections that were not in oracle.I thought of writing to a temporary geodatase. However, after importing the feature from the geodabase to oracle, I still face the same issue. Because, it is an esri issue, the geometry validator is not able to detect them. However, there used to be a transformer called ArcSDEGridSnapper which is now deprecated. How could I replicated the ARcGRidSnapper function in my workbench in order to identify and exclude (or repair) the features that will cause geometric issues in ESRI?
I put the link of the data I try here which is open data from the Quebec Governement Rôles d'évaluation foncière du Québec - Rôles d'évaluation foncière du Québec géoréférencés 2013 - Données Québec (donneesquebec.ca) The problem table is B05V_UNITE_EVALN.dbf . When I open it in ArcGIS Pro, I can see 3000000 + records but in FME I see only 1500000.
Hi all, here it says that the current supported version for the LandXML Reader/Writer is version 1.1 and that further support is planned for the future. The current version of LandXML is 1.2. Does anyone know anything about the support for version 1.2 or the future version 2.0? Thanks in advance in case you have any info, cheers!
I am using Civil3D to model a wastewater pipe system using the CRS EPSG:3380. Then, I converted it to IFC using the IFCInfraexport command. During this export process, I noticed that an IFC Project Base Point was created.I then imported it into FME, using the Reader (IFC) and Writer (Shapefile), also with CRS EPSG:3380. After opening the resulting file in QGIS (also using CRS EPSG:3380), the objects are not in their correct positions.I suspect this may be related to the IFC Project Base Point. Can anyone help me understand this situation and how to correct it? Is there a transformer that can modify the IFC Project Base Point?
Seeking help,I have an IFC file containing information about sewage pipes. In theory, it should contain two types of object classes (with geometry), namely IfcDistributionChamberElement (Manhole) and IfcPipeSegment (pipe). These classes use their subclasses as connectors, namely IfcDistributionPort (at each object node). Finally, these IfcDistributionPorts should be connected to each other using a relationship class called IfcRelConnectsPorts. My problem is that when I import the IFC file as a reader, the class IfcRelConnectsPorts cannot be found, which prevents me from establishing connections between manholes and pipes. Here is a screenshot. in IFC file (open by notepad) Here is a screenshot. fme dont hv any feature or attribute name IfcRelConnectsPort.
I have an FME 2020 workspace with an MS Access reader in it. MS Access 2013 Runtime is installed on my laptop. The workspace runs correctly. I have two FME Server/Form environments (2020 and 2023) with MS Access 2019 Runtime installed on them. The workspace will not run on either of them. 2020 FME Server wants the MS Access 2013 Runtime installed ("ADO Provider not installed or not compatible with FME architecture. Try installing Microsoft Access 2013 Runtime (x64)"). 2023 FME Flow wants the MS Access 2016 Runtime installed ("ADO Provider not installed or not compatible with FME architecture. Try installing Microsoft Access 2016 Runtime (x64)"). Is that because those versions of FME Server/Flow only work with those versions of MS Access Runtime? Or, is the MS Access Runtime info embedded in the FME workspace and I should install MS Access Runtime 2019 on the my laptop to work with either version of FME Server/Form? Bottom line is I would like to run the workspace o
Hello,I have a SalesForce account that is working but for somehow I'm not able to read data with FME.When setting my account, it was first asking me my username and my password After fixing this, now I'm not being able to create the web coinnection for Saleforces. I'm only receiving the following error message . I went to manage web connection and tried to test the web service for Saleforces but still the same error.Any ideas?
Feature cache works great as a method to inspect all transformers after a workbench has ran, but causes a few issues for me.it hurts performance to cache each and every transformerI lose all the cached data if FME crashes or I close the workbench.I am looking for advice on ways to cache or otherwise save output from only a few transformers. My only idea is to write features out to a file, and later bring back in with a writer. are there other transformers I may not be aware of that can save/recall data after restarting the workbench?
Is it possible to restore the cached data from a ran workbench that has been closed or crashed? I am running a heavy dataset (10s of millions of features) and it takes several hours to run. As I troubleshoot the workbench after, I am bouncing around between the cached inspectors for each transformer. My workbench has been crashing often in this process, and I wish I could re-open it and get back to the full cached state without having to re-run it.
I would like to write features to a local file to read back in later and looking for the best file type for performance.My local machine does not have any DBs to use for this purpose (Oracle, SQL, etc)so I am limited to files I can save to a PC folder.Does FME have it's own DB file type that I could be utilizing? I tried FME Feature Store (FFS) but it has limited functionality, such as not being able to set truncate or table drop on runs. And it's main purpose is to add encryption which I don't need and seems like it hurts performance.I have read on here that CSV is very high performance but I don't want to lose metadata such as data type, len, etc.Excel has a feature limit that does not work for me.
Does any one know how to read the latest file from a One Drive folder. I'm able to select a file from the One Drive folder using a Microsoft OneDrive (Graph) web connection, but I can't find a way to read all the files in the folder and then find the latest. I have read the question regarding reading the newest file for a folder https://knowledge.safe.com/questions/65203/read-only-the-newest-file-from-a-directory.html. It's very helpful condeptually. I would appreciate an thoughts or insight. Thanks,Frank
I am using the feature writer to write new column into a geopackage database. Instead of using the default geom I need to change the name to Geometry, but the writer does not seem to accept the spatial column to have uppercase characters?When I specify the spatial column to be called Geometry it is being writter as geometry in the table. Any ideas how it can be solved?
Good morning!I need to call a stored procedure of DB2 from FME. If I use the IBM Data Studio this script works fine:CALL TESTING.TEST_PROCEDURE('input1','input2',?,?,?,?,?);It has 2 input parameters and 5 output parameters.But when I use the same script in the SQLCreator of FME i always get this error: Literal replacement parsing failed for procedure call to DB2 for z/OS. Failing SQL text {my_script}. ERRORCODE=-4463, SQLSTATE=42601 Does anyone have any experience calling DB2 stored procedures in FME? Any help would be appreciated.I'm using FME 2021.1.
Helllo everyone, I´m quite struggling about loading files to MS Sharepoint on-premise. I´ve found some tutorials, but just for Sharepoint Online. Any ideas please?Lubo
Hello, I am exporting data to kml and in the placemarks list, an html table is included.I would like to have only the placemarks listed without the html table preview. Here is an example: What I would like to get is this:Would anybody have experienced this and know how to sort it out and make it look like the second one ? Thanks,Best regards,Thomas
I created a workbench that reads attachments of AGOL feature layers and write them into a GDB. The scripts works fine for features with one attachment. However, when a feature contains multiple feature, it's only reading one in my script. Does anyone know which setting I have to set, to read all attachments for every feature?
I am interested in read several .dbs files with FME. I have read that this .dbs is a Gupta Technologies SQLBase database file.Is there any chance that FME can read this format?
Hello all, I've been trying to delete a folder containing some data after processing. I cannot use a temp folder so have turned to python to complete the task.I've tried following the comments in the following thread but it doesn't seem to work for me File Copy - DELETE (safe.com)I can get the process to work when 'hard coding' as shown below. But when I try to make it dynamic by replacing 'location' with feature.getAttribute('filepath') and dir with feature.getAttribute('directory') it fails.The filepath and directory attributes are shown below:'filepath' = C:\\Project\\FME\\processing\\data'directory' = 20230925
Hello everyone!We have a file format that we work with, which is used by our engineering world to create bills of quantities for engineering projects.The name of the format is SKN, and in fact it is very similar to csv/excle,Is there a way I can just read it and put it in my workflow?I am attaching an example of the file here (zipped)Thank you!