Using readers and writers to extract and load data.
Recently active
Hello, I’m new to FME and I’m encountering a problem where the same rows of data aren’t being saved to both writers. I have two writers connected to the same database but with different tables. When the data is processed, the one saved in the shp_db_b table and can be seen, but there’s no output for the dashboard table (Even though it said ‘Translation was SUCCESSFUL’). I think the issue might be with the Aggregator transformer, but I'm not completely sure. I've attached the relevant pictures for reference.
Hi,I am trying to put data in a zipped file geodatabase in 4 feature tables. Only 1 table is written to the zipped file geodatabase, the rest are not. (no error message). If I write to an unzipped geodatabase file, the 4 tables in the geodatabase are written. How do I write multiple feature writes in the same zipped file geodata tables? (I have tried feature holders to put tables 1 by 1 in the zipped file geodatabase but that makes no difference).
Hi all,When I write to a newly created Feature Service on ArcGIS Enterprise, the attribute data doesnt populate, all the attribute column data is null.The shape data populates but the attibute data doesnt for the Feature Service.Has anyone come across this when writing a Feature Service to ArcGIS Enterprise using FME?ThanksAnthony
Hi, I have generated a tree in FME that looks like that (data type=buffer)How can I save it as in Excel so it looks the same? I assume the question is how to change buffer data to an image
Hey all, In my previous post It was suggested to use TempPathnameCreator to download these files and once processed, the location and file will be deleted, saving disk space. However, I am unable to view any data in the FeatureReader. In this instance, my FeatureReader has 905 records under the <Generic> Port, but when I view it via Feature Caching, it says “No Schema” for the attribute name and all the values are empty. However, If i click the Columns and hit “select all” it seems that I can actually see the tables, but I can’t seem to access the data with an attribute remover or the likes. Do I need to expose some attribute within the Generic Port <Attributes to Expose>?Any help will be appreciated! Thank you!
Hi all,I am working on a translation in FME, and I’m encountering an issue where my data is being fanned out to multiple locations. However, when FME tries to write the shapefiles to the first file location, the translation stops without any specific warnings or error messages, other than the general "Error running translation."Interestingly, on FME Flow, the process behaves similarly. It doesn't throw any errors, but the translation simply stops after attempting to write to the first location, as if it's hanging or failing silently.I’ve tried to troubleshoot by checking the file locations and permissions, but the issue persists. I would appreciate any guidance or suggestions on what might be causing this or steps I can take to diagnose it further.Thanks in advance for any help :)
Hello,I have an excel files with values in it. I read the excel file, want to use the value from column E (value is 45), use it in a math formular and calculate a new value. At the end the result should be written in to a Feature class in a FGDB. The transformer I want to use is expression value. But the calculation doesn’t work. Has anyone an idea? Thank you!Teresa
Does writing to a MapInfo Extended TAB format take longer than to a MapInfo TAB ? Just wanted to check with the community if this is a known/expected behaviour with writing data to MapInfo Extended TAB and also if there are workarounds to quicken the writing process.Although I have experienced FME 2017 take considerably longer time to write a MapInfo Extended TAB for polygon data that is about 1.2 million in count, I failed to take note of the actual time it took, from the log. I do have a stat for a much smaller dataset, that of 1500 polygons and it took about 14 minutes to write to a MapInfo Extended TAB
Hi! I have a new question today. I want to create centerlines on highways. Now, long lines, without intersections, work fine. However, i get wrong results when fme encounters a intersection, like in the pictures below. I expected this and tried to solve it, but it only became worse. Does anyone know a right way to do it? Thanks in advance!
Microsoft SQL Server Spatial Reader now fails to connect post upgrade to 2020.1. It worked with 2020.0. We are getting this error: Microsoft SQL Server Spatial Reader: Failed to connect using Microsoft OLE DB Driver for SQL Server. Provider error '(-2146824582) Provider cannot be found. It may not be properly installed.'. - is there something we need to install?
I have got some beautiful Excel templates containing tables (not normal ranges). It's quite easy to write to a named range within Excel but I haven't figured out how to write to a Table. Does anyone know how to do so?
I have an excel file that has a list of addresses, and their associated license number.I want to join this to a geodatabase file to output any parcels that have any of the addresses in the excel file. I can’t seem to make that work. Can anybody point me in the right direction? I’ve tried FeatureJoiner and FeatureMerger and can’t seem to get any output without failure.
I’m using the Data Interoperability extension in ArcGIS Pro. I can’t seem to get a excel reader to add in. I’ll set the parameters, it’s not open anywhere else, it’s not password protected or anything like that, and it’s on my local system. When I click ok to add it, fme acts like it’s trying to add it, but then just sits there and spins until it eventually times out. What am I doing wrong? I haven’t used FME in about 7 years or so, but I used it extensively prior to that and never had this sort of issue.
Hello,Is it possible to transform a table (ie from Postgresql, or Excel) into this complicated Json format within FME please? I have attached the json file and also a small dummy sample excel file (which doesnt quite have the correct column headers as its a work in progress).I am completely new to JSON and I have done the JSON Templater tutorial but no idea how to actually apply it to my needs!!Help wanted!!
Hi,I am having trouble reading the names of the groups with which the layer is shared in Esri Enterprise. I am using an HTTPCaller with the following settings, but the Share info does not appear in the JSON response.The only information I get is: "access": "shared". Could you please advise on how to retrieve this information?
Hello All,I’m having an issue where SchemaMapper prefix whitespace (space) when using fmeexpression=.I attached a sample workspace and would appreciate if anyone could test before submitting ticket. This issue came apparent after upgrading to FME 2023. for example: col0=’2’, col1=’3’-->using “fmeexpression=@Evaluate(@Value(col0)+@Value(col1))” returns value “ 5” or “fmeexpression=@Evaluate(@Value(col0)@Value(col1))” returns value “ 23”Previously, using “@Evaluate([return “@Value(col0)@Value(col1)])” returns value “23”. I know 2023 introduced new functionality to SchemaMapper, per transformer help doc and https://support.safe.com/hc/en-us/articles/25407523665165-SchemaMapper-Advanced-Schema-Mapping. Would appreciated if someone could test before submitting ticket. Output SchemaMapperDoc
Hello! I am having some trouble overwriting a hosted feature layer on ArcGIS Online that is public and has editing disabled. I have a geojson file that is updated fairly regularly and I would like to create a workflow that reads the geojson and writes it to an AGOL feature service. I have that initial-publish workflow down, but after I log onto AGOL and change the feature service to public (sharing) and disable editing, subsequent runs of my FME tool fail and produce an error stating, "Feature Service 'xxx_layer' does not support writer mode ''. Its owner may have disabled inserting or editing features. Writes may fail if the current user is not the owner or administrator". That error makes sense since I've disabled editing to the feature service, but I'm wondering if there is a way for FME to overwrite the feature service without me having to enable edits on the AGOL feature service. Because the data is public facing, I cannot allow edits to be enabl
Hi all,FME supports writing to USD file, but there is no option in the reader for USD. How would I go about reading a USD file in FME? Thanks,Michael
HiQuick question before I fall back on trial and error, because my dataset is quite big, but does anyone know if changing the partitioning attribute order on a partitioned parquet writer determines the partition folder hierarchy? The doc says its the schema order which determines the partition hierarchy, I’m hoping to override the reader’s attribute order. I’m hoping manually editing the writer attribute order will determine partition hierarchy. Thanks.
Quick and easy question I hope: does FME 2024.2 support the new ArcGIS Online data types (Date Only, Time Only, Timestap Offset and Big Integer) as described here: https://www.esri.com/arcgis-blog/products/arcgis-online/mapping/time-is-on-your-side-with-new-field-types-in-arcgis-online/
Hello everyone,I have a question regarding the fme_feature_type. I encountered a problem in my workspace regarding the SchemaMapper which (after working properly before) gave me the following error:SchemaMapper_Mapper (SchemaMappingFactory): A required column was not found in the table. Row fme_feature_type will be skipped. After doing some testing I realized the attribute fme_feature_type was <missing> across the board in this particular conversion which I believe is required for the SchemaMapper to work. I’m somewhat stumped because sometimes the workspace functions properly and the attribute has proper entries. I noticed especially with larger datasets that fme_feature_type just goes missing between transformers. Some culprints that I found were for example the SubstringExtractor and the AttributeKeeper. The data goes in with fme_feature_type properly filled and comes out with the data missing.I don’t think this is expected behaviour but maybe someone can shine some light on w
Hi All, I am trying to gather information on upgradeable transformers and see that current version is available as part of fmw file extension. I want to know where does it get the information on latest version, Is this information saved somewhere. In this example, AttributeManager is currently at ver 2 but latest version is ver 4. I am not sure where this version information stored. Thanks
Ultimate Goal: to use FME to test if there are ESRI annotations that fall on top of each other. Issue being experienced: When the ESRI annotation is displayed in FME Inspector, the annotation has been shifted. My theory is the “shift” is something to do with the annotation is left justified in ArcGIS Pro and its placement of the annotation is based on a point in the bottom left corner. In FME the annotation point seems to be placed along the bottom centre. Question: Is there a way to have FME place the ESRI Annotation based on the same placement point?ORHow can we shift the annotation when being viewed in FME so that it is placed half of the width of the annotations to the left along the annotation axes? ArcGIS Pro: 3.2.3ArcGIS SDE: SQL 2022FME Form: FME(R) 2024.1.3.0 (20240927 - Build 24627 - WIN64)FME Annotation Reader Format: Esri Geodatabase (ArcSDE Geodb) See attached imagery for example of annotation shift.
Y’all.I have a workspace, that exports a number of database tables to a File GeoDatabase.The workspace uses a FeatureReader and a Writer with three dynamic featuretypes (for point, line and polygon features). The writer is “Esri Geodatabase (File Geodb Open API)”.When I run it in Desktop(Form) 2020.2, it works perfectly.When I run it as a job on Server(Flow) 2022.2, all features issues a warning, e.g.FileGDB Writer: A feature with feature type `HOERSHOLM_Afløbskomponent_point' could not be written I’ve tried running it in Desktop 2022.2, and this apparently doesn’t work either.I’ve tried to upload the workspace from here, but this still fails the same way.The output path is a UNC path to a ZIP file.Does the FileGDB writer have an issue with 2022.2 or any of the above details ?
A client of ours is changing their spatial data format from MITAB to ESRI GDB. They use domains in their GDB and we don’t have an ESRI licence so am unable to read these in correctly with the domains exposed. I have requested the XML to go with it as per what I found in other threads.Is the best way to give it geometry to pop on a map a FeatureMerger with the XML and GDB, matching on an ID they have?I can’t help but think this is a poor way of doing it (it took forever as it’s a large dataset when I tested it), but without the ESRI licence I think I’m a bit stuck for options. Wondering if someone has a better solution.Using FME Form 2024.1Thanks!