Using readers and writers to extract and load data.
Recently active
Hello everybody,I found many discussions about this topic, but, I just want to renew this discussion. Is there any way, how to convert word (docx) file to PDF format in FME, please?Thank You so much for all tips!Lubo
Hello There, I’m hitting a brick walk with trying to get FME to talk to OS Downloads API, as anyone found any advice and guidance on this?
Hello, we are trying to use our FME server to run all of our data conversion via the API. We have created a workbench and uploaded it. We set the service to Job Submitter. When we run it we can not see were the output was written to. The log indicates that job was run successfully but the log does not have any mention of an output location. We have tried to set the output File Geodatabase location to a network drive: “\\nos.noaa\MCD\FADS\FADS_Projects\FME_Workspace_Output\Weekly_Atons” and a local server drive: "F:\FME Server System share\repositories\Testing_Nate\ALL_USCG_Weely_Xmls_to_GDB\output\Weekly_Atons"Any help would be greatly appreciated
Below you can see line and point features. Let's say each line segment has its own unique ID - in the example below, it will be from 1 to 6. I want to copy IDs from lines to poles that they intersect.According to my example, it would be:Point A: ID 1, 2, 3, 4Point B: ID 4, 5, 6 I have thousands of lines and points. What’s the best way to do it?Appreciate any help!
Hi there, the table shown in the pdf image is missing in my data inspector. In some newer pdfs it does apppear. Can anyone help me '’expose'’ the tables. Also my attributes are only showing as format attributes. This makes it very difficult for me to turn my filtered data (.dwg file) Into an Excel. edit: I got it the table working by turning on all the parameters in my reader. I dont know which parameter did the trick…
Hello Guys,i have an issue with bringing our geometry from a oracle 12C format in a AIXM gml format. Whatever i tried so far, the writer just refuses to write any geometry, while anything else seems to work just fine. The output was good enough to satisfy the AIXM validation but it is useless for us until i am able to write the geometry too. I am trieing to achieve that with the help from the XML-Templator and so far, this is how it looks:It looks fine to me, the coordinates are hard coded for testing and will later be replaced by a variable holding the coordinates for each object. But i would like to write any geometry in the first place before i think about that. I will provide my workspace and the gml i managed to generate with the hope that somebody can make out the issue at hand. Ty for reading this and every bit of help is appreciated!
I’m trying to use the DwgStyler to convert a GIS, point feature class to an AutoCAD drawing with inserts and attributes.
I have this json file (see the attached txt file) that I want to load into a table (shown as in the attached excel file). I have done many json conversions over the years, but this one puzzled me quite a bit and could not figure out a good way to do it. The difficult part is that for each asset Id, there could be a few years of emissions. Each emission has two emission type, n2o and co2. How can I capture each year and its emissions into rows based on the emission type to be pivoted? { "assets": [ { "Id": 25494428, "Emissions": [ { "2021": [ { "EmissionsFactor": 1, "EmissionsFactorUnits": "U1", "n2o": 10 }, { "EmissionsFactor": 2, "EmissionsFactorUnits": "U2", "co2": 100 } ] }, { "2022": [ { "EmissionsFactor": 3, "EmissionsFactorUnits": "U1", "n2o": 11
Note: we are primarily using FME Form version 2023.2.4.0 (build 23785), but have also tested this on 2024.0.1.0 (Build 24202) with similar results.We have received DGN files that are referencing models that are both internal and external to DGNs themselves. These external DGN files are located in the same directory folder as the file being read. We are interested in having the reader (Bentley MicroStation Design (V8)) read not just the primary DGN, but also the referenced models.In the parameters for the reader, we check the box for “Read Elements from Reference Files” and set the value for “Max Depth of Reference Files to Read” to something arbitrarily large like 20.Selected parameters, but have tried a variety of combinations of values with no difference in outcomes.Because we are interested in reading data from different files, the “Single Merged Feature Type” option is selected.When the reader is run, we see data from the primary DGN, but nothing from any other DGN that it it is re
Hello , i have a Python script works good into Pycharm without problems , to do some tasks on excel file then i am using the new excel file output of Python as input in FME .i would like to use Python caller , to put the same script inside FME.how could I change the script to be compatible with Python caller ?which changes should I consider and think about it ?Thanks in advance
I’m doing a routing analysis and I have a road network that I need to create new nodes along where I have points for addresses. I used the AnchoredSnapper transformer to ensure that the points align with the line data. The point data (addresses) is a separate dataset from the line data (network). Does anyone know how to create new nodes along an existing line using point data?
I'm trying to load OpenStreetMap using FME. This works great with small datasets in 2012, however as soon as I start playing with large datasets (millions of features) I hit the problem that the FME OSM reader acts as a grouper - it reads the entire dataset in before it actually trys to translate everything. Does this have to happen? Is there a way to disable it or is this a limitation of the XML reader? It's massively slowing down everything because even with 32GB of RAM, FME is still filling it up and then writing to temp disk space (despite the original dataset only being about 7GB uncompressed). Using 2012 SP4 64bit. 2013 13206 is 5.5 times slower on the small dataset, so not using that despite changes in #13082 to make "it better with large datasets" - not sure what that means.
Hi everyone, I have several Esri personal Geodatabases with similar schema but also some tiny differences.That is, they are required to have identical schema but in fact some don't due to various reasons. Some feature types and attributes are unexpected, while some required ones are missing. Now I want to choose a standard one from them as a template and merge them all to get a standard destination mdb. How can I achieve that?
Within the User Parameters I have added the option to Select a File.More specific the user has the option to select a Geodatabase (Items to Select).When the user has selected the Geodatabase, I like to have the user also select the database of his/her own choice within that Geodatabase. Is there a way to configure that?
Hi,I am just in the process of migration testing from FME Flow/Form 2023.1 to 2024.1. It seems all of our GeoDB dynamic writer fails the following error:Esri Geodatabase Writer: Feature Type Definition 'd_y_n' was requested, but not defined. Please visit https://www.safe.com/support All existing runs perfect on 2023.1 Flow and Form - not sure why it fails. Tried all possible scenarios, still fails. I have changed it to a normal writer - then it worked fine.GeoDatabase - SQL Server 2017, SDE Version 10.9.1 (pro 2.9 created)Pro Version 3.3.1 installed on PC / ServerRudy
Hi, I am a total novice with FME - will be going on some training soon, however I am trying to get familiar with the software prior to that. I have what I think is a very simple task but can't seem to figure it out. All I want to do is create an excel file with all of the feature classes contained in my geodatabase. My geodatabase (version 10.1 in ArcGIS) contains feature datasets - although I do not these listed in my excel output. Sorry for asking such a basic question - I am new to the knowledge areas/and community
Hello,I was wondering if FME can read in data from Oracle SQL Views?If yes, great. How?
Hi there!I want to create polygons from an attribute that contains a string of coordinates and other information. My problem is that I don't know how to only extract the coordinates from the string and then create the polygons by their ID attribute. The string in the coordinates attribute looks like this:“{"type":"Feature","properties":{},"geometry":{"type":"Polygon","coordinates":[[[13.707920553133594,60.03475791657763],[13.708950521395312,60.03304306231432],[13.705474378512012,60.03160680337132],[13.702513219759567,60.02997753853561],[13.702255727694139,60.030577803349054],[13.703929426119434,60.03184261136259],[13.706161024019824,60.032571461785544],[13.707920553133594,60.03475791657763]]]}}” ID attribute 1 to 10 Regards, Ricardo :)
I have a DXF file that consists of multiple geometries and attributes. I want to convert this DXF file to a file geodatabase with multiple layers based on each geometry type in the DXF. The different layers also need to retain the same attributes as the DXF files. I attached the file as a zip to this post.I tried loading the DXF file in FME using the Autodesk Autocad DWG/DXF reader and splitting the geometries using a GeometryFilter. That worked fine. However, the attributes disappear when I read the DXF file in FME. Do you have any suggestions on how to retain the attributes of a DXF file when reading it in FME and converting it to a GDB? The data was gathered with a Leica gs18T in case that helps.
Context: Feature Type with a WHERE clausePurpose: To only read records relating to a user defined Iwi (Maori Tribe).When the WHERE Clause is, for example: "IWI"='Whakatōhea', the transaction is successful and returns the expected records. However, when the WHERE Clause is set with a User Parameter "IWI"='$(IWI)'and the User Parameter is set with the value Whakatōhea, the transaction is successful but no records are found.This behavior is only affecting records with macronated vowels, which is common in Maori language. Users need to be able to input their Iwi of interest for this workbench.Can anyone suggest where the WHERE clause setup might fail?Many thanks
Hi,Suddenly, the feature count in FME Desktop disappeared, even with the "Enable Feature Counting" option ON.The log shows: Cannot connect to feature count server "65051."Why does this happen?The problem occurs with all formats.Thanks.
Hello,I am writing to ESRI geodatabase that uses MS SQL. Every time I get "Unable to convert value taken from Z_ORIGIN keyword to a float data type". So far i have:Used a 2dforcer,changed the "z scale and z origin" to 0 or 0.00000under table creation parameters set "Contains Z Values" to No (also set to yes, and blank on other trys)Recreated the writersSet the writer geometry to table, not a point file.Nothing has worked. I am under the assumption that the writer is passing a "Null" value to the writer which in turn says that "null" cant be a float value.Finally I have looked at the other posts on this and nothing has helped. Any suggestions? Just to update, I used a vertex creator to make new geometry, and still didn't work, but i can insert all of this into a file geodatabase and then import that to my enterprise database. If anyone has any help please post it, this issue doesn't have a good answer on the forms yet.
Hi All, i’m having an issue writing to an AutoCAD DWG file, with a template file. I want to preserve the Model Space, but not the Paper space as i’m editing some attributes within the drawing title block in FME which I want to write back out in the paper space.Even though I am setting preserve paper space in the writer to No, the original blocks from the template file, including the original attribute values, are being written as well as a copy of the block with the new attribute values I have updated in FME. As a result I have 2 overlapping blocks, 1 with the new values I want to keep and 1 with the original values I am trying to replace. I just want a single block with my new values.In the attached, you can see the output from the writer, with the same block duplicated with the new value I have updated and the old value in the template (highlighted in yellow).Any thoughts/ideas/assistance with this would be greatly appreciated, whether this is possible or not possible. I have done si
Recently I put different tables into a PostGIS database. One of these tables contains 23M unique records and does not contain spatial data. I would like to read them into a FME workbench. Do you have some suggestions how I could improve my reading process?Is it possible for example to preselect already a set of columns I need while reading my table using 'SQL to Run before Read'?’ If so do you have a example SQL querry? Is there a performance difference between 'SQL to Run before Read'?’ and the WHERE clause option in the Constraints menu?
Hi,I'm using two SentinelDownloaders in my workspace: one to download data from a specific year and another to download data from the previous year. At the end, my workspace shows a "FAILED" message in the API after completing the first SentinelDownloader. I understand there is a conflict because it's the same transformer being used for different dates in the same execution.How can I run this workspace without problems?Thank´s