Using readers and writers to extract and load data.
Recently active
The last few weeks I have been getting an error message whenever I try to frequently run my workspaces. Since I am testing transformers, and attempting to find the ones that create the most appropriate outputs for my task, which is converting a shapefile to match with a preset schema. If I run the full workbench and then change something because the output did not match what I needed, then run the workbench again. I get an error that says “Failed to write to file” with the file path pointing towards a .dbf filetype in my output folder. The only fix at the moment is completely closing FME and reopening. But doing this for every small iteration is not feasible long term.
Hi All,For a project I need to write a geodatabase with a time_only field in one of the objects.To be able to do this I had to change my Python Compatibility to Python 3.9, which only works if Arcgis Pro 3.2 is installed.Otherwise I get this very helpfull error:But I don’t want to use 3.2 as default. Now I have 2 folders:C:\Program Files\ArcGIS\Pro2_9C:\Program Files\ArcGIS\Pro3_2I manually renamed the Pro folder to include the version number.The issue now is that FME can’t find my Arcgis Pro, which makes me very sad 😥. How can I tell FME to just use C:\Program Files\ArcGIS\Pro2_9 and stop looking for C:\Program Files\ArcGIS\Pro.Only when I want, I manually will change the folder to 3_2.
I have dgn/dxf formatted CAD 3D lines which are "cables" below the ground. These cables are sometimes 1m below ground and sometimes 50cm and 10cm etc. below the ground. I have pointcloud LAS data as ground elevation data.Now I want to extract the cables(lines) which are below the ground upto 50cm. I want to cut the cables layer with elevation model to selct the cables network from 0 to 50 cm below the ground.How can I cut those lines? I am trying with qgis and FME but, unable to get the right solution. Anyone has idea what software or methods to follow.
HI All,What the best way of loading data into a blank template GDB? Attributes, domains, etc are already set up in the template GDB but need to know how to load data into the template using FME,Do I need to use the template GDB in the writer and then map the fields from the reader to the writer?Any idea how to do this?Thanks
In FME Form 2024.0.1.0 I got an error when trying to read data or schema with “Microsoft SQL Server Non-Spatial” Reader: “Unable to decrypt data”. On the same server, connection with SQL Server Management Studio works fine.Does anybody know this problem or has a solution?Regards, Martin
HelloI have several GDBs with several FCs in different subdirectories. However, all GDBs have the same structure (same FC with identical attributes). I would like to merge all the data depending on the FC and then process it further in an existing workflow. Using the example, I was able to read and save all data, but it deleted all attributes and combined all FCs into one single FC. My question now is how I could read all FCs with the same name from all GDBs, merge them in one FC and then process them further in an existing workflow.
I simply need to update a geometry column in a SQL Server table that is previously set to NULL. Could someone provide me with a simple example? I can't do it neither with a SQL Executor (previously using a GeometryExtractor to convert this geometry in Microsoft SQL Server Binary) nor with a featureWriter. I found this conversation from a while back but it didn't help me: Thank you!
Good eveningI produce a worbench wich create a file gdb and different features class (table, polyligne, polygon) from a excel file wich describe :fme_feature_type_name fme_feature_type_alias name alias fme_data_type geometry native_data_typeIs it possible in the same excel file :to create domain value (domain code and domain describe) to apply Global Id to apply editor trackor Thank you
Hey all, I am very new to FME and this may be a basic question, But I currently can’t find the answer elsewhere so I figured I would post and see if anyone can point me in the right direction. Currently, I am exporting from a GE small world database and moving the data to a FGDB for data analytics in other software. This is a complete export of all available data. That much I have been able to figure out with a few minor transformations. What I can’t yet figure out is how do I export only a small portion of the database. Say by a predefined polygon within the existing data set. For example My DB crosses a number of contiguous cities all having a defined boundary within the drawing. How do I tell FME to select and export only the lines and other objects within the city boundary of interest and excluded the data within the other city boundaries? Ultimately I need this breakdown so I Can export this to AutoCAD since the full DB is entirely too large for one drawing. Any help is apprec
HelloI find this workbench on this website and i try to use it with FME 2024. It doesn’t work with the new version and i would like to know what is the issue. Could you please explain ?Thanks a lot
Hi,I'm working with Sentinel-2 images. I would like to know if it's possible to use FME to remove or clip clouds from images. Does anyone have any ideas? Is it possible to use Google Earth Engine (GEE) with FME?Thank you.
Hello, GML always writes a hyperlink at the beginning of the output, how can I fix this?
I have a lot of excel spreadsheets that all have the same attribute schema. However, there are a varying number of header lines that precede the data in each. In FeatureReaders & Readers, we define the start point for data by line number. Given the consistency of the attribute schema and the inconsistency of the header spiel, I’m trying to think of a way to only read in the ssheets from the start of the data/attribute names, i.e. dynamically, defined by the first attribute name rather than the line number (I guess). Any ideas?
Hello experts,My question is simple.when using the Directory and File Pathnames to access a directory, can I then read files from that directory?I would like to be able to view and query the data in those 1042 filepaths passing the testfilter.see my current workbench: any help would be much appreciated,thank you.fb
Hello all, I am a beginner with CityGML and am currently trying to convert a dataset to CityGML 3 with generics extensions using FME Workbench.I re-organized the features in TrafficArea and added some new generic attributes. Then, I want to map these new features back to TrafficSpace to build the child-parent relation. But I always failed. I am not sure whether I used the wrong way to create the new TrafficSpace, and I didn’t find the tutorial online either. My workflow for the TrafficSpace is shown below. I extracted the boundaries from the TrafficArea and set them with lod2MultiCurve as the TrafficSpace back. Welcome for any suggestions or assistance! Thank you very much.
Hello togetherI am currently working with two watercourse datasets from different sources, which unfortunately do not take the same course depending on the region, although in reality there is clearly only one watercourse. For this reason, I would like to merge the datasets or assign the attributes of one dataset to the line segment of the nearest neighbour of the other dataset.I've already tried a bit myself in ArcGIS Pro, but haven't come up with a clever solution. Do any of you have an idea for this?Thanks in advance for an answerBest regardsDani
I have one FME workbench running on application server to export all the GIS sql tables into MapInfo tab files. It was running fine before but recently failed a couple times, its failed to export tab files after running 50 minutes or so, and each time its failed at export different sql table. I checked disk space and sql tables and they are fine to me. Any suggestions are greatly appreciated, the log file is attached.
HiI need to update several Excel files within a zip file. I have contacted support and they have created a problem report for the development team (FMEENGINE-83267, I have reproduced the problem with updating multiple Excel files within a zip file). FME Form 2023.2.1.0Build number: Build 23774Meanwhile I need a work around, any ideas?BrFelipe Verdú
I’m trying to load a csv that is saved in sharepoint. I want to convert this to Excel as well as process the data and export to other formats. I can access the data in a browser. Nothing is returned by the httpCaller or the SharePointOnlineConnector.
Good Day everyoneI have some difficulties reading an ifc file. There is an IfcBuildingPartElement that is apparently ‘too’ complex to read. When excluding Geometry from the FeatureReader running it is successful, but as I am trying to analyse the Geometry, it is kind of needed to include it whilst reading. The Error message does not tell me which of the objects it read failed, which makes it hard to figure out how to bypass the geometry. Does anybody have any solutions how to get it to skip/process the complex pieces? I have tried to ‘Continue Translation’ for Rejected Feature Handling, no luck FME Workbench Message:Processing on a solid has failed. The solid may be too complex, not closed, or not orientable. Feature Reader Settings: CheersFred
Hello,Currently, I have a process where I am doing a PointOnAreaOverlayer. I then create about 23 List Attributes. As of now, I have 23 List Summers to achieve my requirements. I then port all the List Summers into one Attribute Manager, remove all the non-summed fields, aggregate all the points grouped by the Primary Key, and then I join that back to the area layer so that it holds the summed values and stays an FMEPolygon and not a MultiFMEPolygon.Is there a way to do this “better”? I have to redo this process on another Polygon Feature Type and it’s cumbersome. Kind Regards,Senad
Note: I already solved this issue by forcing everything in “MGA2020-55_FME”, however the way FME writer handles GDA2020 data seems strange.I am trying to update an “EPSG7855” table from SQL to an “EPSG7855” feature service in ArcGIS Online. After checking the log, FME seems do not think EPSG7855 is GDA2020 Zone 55 and trying to reproject the data. Which cause the GDA2020Zone55 layer not align with GDA2020 Zone 55 basemap. Log: 2024-06-20 09:27:58| 0.9| 0.1|INFORM|The ESRIWKID number of the FME coordinate system 'MGA2020-55_FME' is '7855'2024-06-20 09:27:58| 0.9| 0.0|INFORM|ArcGIS Online Feature Service Writer: Requesting metadata for Feature Service at 'https://services-ap1.arcgis.com/w6r4Ll*/arcgis/rest/services/Property/FeatureServer'2024-06-20 09:27:58| 0.9| 0.0|INFORM|ArcGIS Online Feature Service Writer: Found layer/table 'property_view' with ID 4 for feature type 'property_view'2024-06-20 09:27:58| 0.9| 0.0|INFORM|ArcGIS Online Feature Service Writer: Requesting me
Hi everyone,I give you my work on the transformation of Runway from AIXM 4.5 reader to AIXM 5.1 writer.All seems to be fine with the structure but when i try to add some annotations to keep the <txtRmk> attribute inside an <aixm:annotation>, i didn’t suceed to keep the structure complete.When the branch is disabled, it’s fine. When the branch is enabled, all is going wrong.Could you please have a look and please give me your feedback.For the FME documentation team https://support.safe.com/hc/en-us/profiles/17698677148429-Liz-Sanderson: the workbench given on this page : AIXM 4.5 and 5.1 Reading, Writing and Validation - EU Airports Demo – FME Support Center (safe.com) doesn’t work with FME 2024. My workbench seems to be good except the annotations branch and i’m glad to help you in the way to update your workbench.Nice week-end
Hello everyone Im playing around with FME FLOW and uploaded my workspace. The workspace is running well with several parameters and writing me an OBJ file into my ressources and finally writing an HTML file (which opens a 3dviewer which opens the OBJ file).When im running the workspace in FME FLOW i choose datastreaming Service, and after success it opens the HTML file in my Browser.When i create a WebApp it is also running well and in the end opening the HTML file and showing the OBJ in the 3DViewer.But since the WebApp is quite limited with layout etc. i created an easy HTML Website on my Server. Here i added a send request with the webhook url of that workspace and the get method.And actually it is running, but after success its giving me a link to download a zip with the HTML and OBJ file.To me it seems because im using the Get method, it is just putting all the results into that zip to download. I tried a bit around and also searched in forum but didnt find an answer.Am i missing
SpatialFilter gives more intersections than expected, any clue?For a parcel I want to compute the area covered by buildings on that parcel. The start situation, with one parcel and some buildings. My next plan was to use a SpatialRelator to create a list of buildings located at the yellow parcel.I tested this approach using a SpatialFilter first to see whether the intersect function works. I expected to get back only the 2 red buildings within the parcel polygon. However, I got this:A subpolygon of one the buildings is also selected. Did I something wrong?My settings of the SpatialFilter:Any ideas how to solve this? I tried other Predicates to test as well but so far no success.