Using readers and writers to extract and load data.
Recently active
I found that Industry Foundation Classes (IFC) (Tech Preview) [IFC_API] Reader in FME 2024 cannot reader IfcOpeningElement features and non-subtracted wall, slab etc. features.In some cases it's essential to read IfcOpeningEelement features as simple solid geometries and non-subtracted features.It would be nice if the [IFC_API] reader would have parameters equivalent to the "Subtract Openging Geometries" parameter in the current Industry Foundation Class STEP/XML Files (IFC) reader.
hello , 👋 I'm working on finding the path for specific lines and reorder points .I have several lines, each defined by a start and end point, but these lines also contain intermediate points. Should I merge the intermediate points with the lines before using a shortest path finder, or how will the transformer know which intermediate points belong to each line if I don't provide them? My goal is to reorder all points, including the intermediate ones, to find the correct sequence from point A to the final point, such as A, B, C, D, E, F, G.
Is it possible to write an image from a jpeg url into a file geodatabase? In other words, I want to store images directly from a url into a geodatabase. I need to extract the image from the url and move that image into a geodatabase. Thank you!
How to securely achieve the desired order of in which are feature types (tables) written in the database? I have some FK dependecies in the target tables and I have somehow discovered that its written from the bottom to the top of the feature types list. If its not written from the parent to the childs it crashes on FK violations. I know there is an idea registered. But so far what are the options? It consider the inserts/updates and also deletes where i would need the inverse order.Thank you for the suggestions.
Hello, I’m new to FME and I’m encountering a problem where the same rows of data aren’t being saved to both writers. I have two writers connected to the same database but with different tables. When the data is processed, the one saved in the shp_db_b table and can be seen, but there’s no output for the dashboard table (Even though it said ‘Translation was SUCCESSFUL’). I think the issue might be with the Aggregator transformer, but I'm not completely sure. I've attached the relevant pictures for reference.
Hi,I am trying to put data in a zipped file geodatabase in 4 feature tables. Only 1 table is written to the zipped file geodatabase, the rest are not. (no error message). If I write to an unzipped geodatabase file, the 4 tables in the geodatabase are written. How do I write multiple feature writes in the same zipped file geodata tables? (I have tried feature holders to put tables 1 by 1 in the zipped file geodatabase but that makes no difference).
Hi all,When I write to a newly created Feature Service on ArcGIS Enterprise, the attribute data doesnt populate, all the attribute column data is null.The shape data populates but the attibute data doesnt for the Feature Service.Has anyone come across this when writing a Feature Service to ArcGIS Enterprise using FME?ThanksAnthony
Hi, I have generated a tree in FME that looks like that (data type=buffer)How can I save it as in Excel so it looks the same? I assume the question is how to change buffer data to an image
Hey all, In my previous post It was suggested to use TempPathnameCreator to download these files and once processed, the location and file will be deleted, saving disk space. However, I am unable to view any data in the FeatureReader. In this instance, my FeatureReader has 905 records under the <Generic> Port, but when I view it via Feature Caching, it says “No Schema” for the attribute name and all the values are empty. However, If i click the Columns and hit “select all” it seems that I can actually see the tables, but I can’t seem to access the data with an attribute remover or the likes. Do I need to expose some attribute within the Generic Port <Attributes to Expose>?Any help will be appreciated! Thank you!
Hi all,I am working on a translation in FME, and I’m encountering an issue where my data is being fanned out to multiple locations. However, when FME tries to write the shapefiles to the first file location, the translation stops without any specific warnings or error messages, other than the general "Error running translation."Interestingly, on FME Flow, the process behaves similarly. It doesn't throw any errors, but the translation simply stops after attempting to write to the first location, as if it's hanging or failing silently.I’ve tried to troubleshoot by checking the file locations and permissions, but the issue persists. I would appreciate any guidance or suggestions on what might be causing this or steps I can take to diagnose it further.Thanks in advance for any help :)
Hello,I have an excel files with values in it. I read the excel file, want to use the value from column E (value is 45), use it in a math formular and calculate a new value. At the end the result should be written in to a Feature class in a FGDB. The transformer I want to use is expression value. But the calculation doesn’t work. Has anyone an idea? Thank you!Teresa
Does writing to a MapInfo Extended TAB format take longer than to a MapInfo TAB ? Just wanted to check with the community if this is a known/expected behaviour with writing data to MapInfo Extended TAB and also if there are workarounds to quicken the writing process.Although I have experienced FME 2017 take considerably longer time to write a MapInfo Extended TAB for polygon data that is about 1.2 million in count, I failed to take note of the actual time it took, from the log. I do have a stat for a much smaller dataset, that of 1500 polygons and it took about 14 minutes to write to a MapInfo Extended TAB
Hi! I have a new question today. I want to create centerlines on highways. Now, long lines, without intersections, work fine. However, i get wrong results when fme encounters a intersection, like in the pictures below. I expected this and tried to solve it, but it only became worse. Does anyone know a right way to do it? Thanks in advance!
Microsoft SQL Server Spatial Reader now fails to connect post upgrade to 2020.1. It worked with 2020.0. We are getting this error: Microsoft SQL Server Spatial Reader: Failed to connect using Microsoft OLE DB Driver for SQL Server. Provider error '(-2146824582) Provider cannot be found. It may not be properly installed.'. - is there something we need to install?
I have got some beautiful Excel templates containing tables (not normal ranges). It's quite easy to write to a named range within Excel but I haven't figured out how to write to a Table. Does anyone know how to do so?
I have an excel file that has a list of addresses, and their associated license number.I want to join this to a geodatabase file to output any parcels that have any of the addresses in the excel file. I can’t seem to make that work. Can anybody point me in the right direction? I’ve tried FeatureJoiner and FeatureMerger and can’t seem to get any output without failure.
I’m using the Data Interoperability extension in ArcGIS Pro. I can’t seem to get a excel reader to add in. I’ll set the parameters, it’s not open anywhere else, it’s not password protected or anything like that, and it’s on my local system. When I click ok to add it, fme acts like it’s trying to add it, but then just sits there and spins until it eventually times out. What am I doing wrong? I haven’t used FME in about 7 years or so, but I used it extensively prior to that and never had this sort of issue.
Hello,Is it possible to transform a table (ie from Postgresql, or Excel) into this complicated Json format within FME please? I have attached the json file and also a small dummy sample excel file (which doesnt quite have the correct column headers as its a work in progress).I am completely new to JSON and I have done the JSON Templater tutorial but no idea how to actually apply it to my needs!!Help wanted!!
Hi,I am having trouble reading the names of the groups with which the layer is shared in Esri Enterprise. I am using an HTTPCaller with the following settings, but the Share info does not appear in the JSON response.The only information I get is: "access": "shared". Could you please advise on how to retrieve this information?
Hello All,I’m having an issue where SchemaMapper prefix whitespace (space) when using fmeexpression=.I attached a sample workspace and would appreciate if anyone could test before submitting ticket. This issue came apparent after upgrading to FME 2023. for example: col0=’2’, col1=’3’-->using “fmeexpression=@Evaluate(@Value(col0)+@Value(col1))” returns value “ 5” or “fmeexpression=@Evaluate(@Value(col0)@Value(col1))” returns value “ 23”Previously, using “@Evaluate([return “@Value(col0)@Value(col1)])” returns value “23”. I know 2023 introduced new functionality to SchemaMapper, per transformer help doc and https://support.safe.com/hc/en-us/articles/25407523665165-SchemaMapper-Advanced-Schema-Mapping. Would appreciated if someone could test before submitting ticket. Output SchemaMapperDoc
Hello! I am having some trouble overwriting a hosted feature layer on ArcGIS Online that is public and has editing disabled. I have a geojson file that is updated fairly regularly and I would like to create a workflow that reads the geojson and writes it to an AGOL feature service. I have that initial-publish workflow down, but after I log onto AGOL and change the feature service to public (sharing) and disable editing, subsequent runs of my FME tool fail and produce an error stating, "Feature Service 'xxx_layer' does not support writer mode ''. Its owner may have disabled inserting or editing features. Writes may fail if the current user is not the owner or administrator". That error makes sense since I've disabled editing to the feature service, but I'm wondering if there is a way for FME to overwrite the feature service without me having to enable edits on the AGOL feature service. Because the data is public facing, I cannot allow edits to be enabl
Hi all,FME supports writing to USD file, but there is no option in the reader for USD. How would I go about reading a USD file in FME? Thanks,Michael
HiQuick question before I fall back on trial and error, because my dataset is quite big, but does anyone know if changing the partitioning attribute order on a partitioned parquet writer determines the partition folder hierarchy? The doc says its the schema order which determines the partition hierarchy, I’m hoping to override the reader’s attribute order. I’m hoping manually editing the writer attribute order will determine partition hierarchy. Thanks.
Quick and easy question I hope: does FME 2024.2 support the new ArcGIS Online data types (Date Only, Time Only, Timestap Offset and Big Integer) as described here: https://www.esri.com/arcgis-blog/products/arcgis-online/mapping/time-is-on-your-side-with-new-field-types-in-arcgis-online/
Hello everyone,I have a question regarding the fme_feature_type. I encountered a problem in my workspace regarding the SchemaMapper which (after working properly before) gave me the following error:SchemaMapper_Mapper (SchemaMappingFactory): A required column was not found in the table. Row fme_feature_type will be skipped. After doing some testing I realized the attribute fme_feature_type was <missing> across the board in this particular conversion which I believe is required for the SchemaMapper to work. I’m somewhat stumped because sometimes the workspace functions properly and the attribute has proper entries. I noticed especially with larger datasets that fme_feature_type just goes missing between transformers. Some culprints that I found were for example the SubstringExtractor and the AttributeKeeper. The data goes in with fme_feature_type properly filled and comes out with the data missing.I don’t think this is expected behaviour but maybe someone can shine some light on w