Data

I have a process that uses a change detector transformer to compare address data from one database and update the data in a second database based on differences in the dataset. It works great normally but the other night it updated, but I had an extra 85000 records that ended up being duplicates of existing records. Both these databases are SQL server ESRI Geodatabases and are using the same SQL server instance. What I think happened is that the database instance was failed over while the FME process was in the middle of running, which disconnected the session temporarily and when reconnected started reading records again which looks like it started reading the records from the start but still included the records that were already read in addition. Is there something I can do or set when a database is failed over in the middle of running a process to prevent this issue?

I have an Excel 365 .xlsx spreadsheet that I am trying to read into a FME 2021 workspace. When I try to read it, it gives me an error message: |ERROR |Excel Reader: Could not open file '...\input.xlsx', file is too large. Try switching to 64-bit FME, or exporting the Excel file to CSV. If the file is exported to CSV, formulas and formatting will be lost...T I cannot change the spreadsheet to a .xls, it has to remain a .xlsx. Any ideas on how to solve this?  The spreadsheet I need to read is 22mb with approximately 93,000 records.  

I have a collection of as built drawings stored as PDF’s and wanted to automate the creation of image files being used as thumbnails in a web application. I was wondering if anyone has done this before. I am currently using the Workbench 2018 PDF reader and attempting to rasterize using either ImageRasterizer or MapnikRasterizer.

I hope this post makes sense. I used a list an attribute splitter -> list exploder -> attribute creator to assign a value based on conditional criteria. I now need to filter the data using the following logic: Take the minimum “_element_index” WHERE “Review Status” (newly created attribute) has a value, else use the MIN(element_index).There would be a Group By: “Project Number”Any help would be greatly appreciated   

Is there anyway to read in attachments while using the FeatureReader transformer. I know there is an option with the ArcGIS Online Reader but I don't know my Where Clause until after certain point in my workflow. Feature Reader was working perfect until I realized I couldn't read in attachments. Any help would be great!

Hi, My workspace has an AGOL reader (reads attachments too). Features are compared to existing SDE records and new features are then processed into the SDE (photos go to our DMS). Unfortunately, all AGOL records and attachments have to be read before comparison - even with our fast internet, it still takes 5 seconds per feature (6 photo attachments). Our test dataset has 1500 records (9k photos) and the production dataset has 100k records.My idea was to read the AGOL dataset WITHOUT attachments and then use an AGOL FeatureReader to just read the new features WITH attachments, but... FeatureReader is (or at least was) unable to work with attachments.The rest of the workspace is fairly involved, so I don't believe this is a case for a WS Runner. Ideas will be much appreciated.Cheers,Mark

I wanted to run a single sql query but with multiple variable value depending on my user input (to a parameter).For Example :When I type in VEGETABLE in my user parameter I want to run “SELECT * FROM <vegetable_name>”, where I have a bunch of different values for my <vegetable_name> variable, additionally I want to join all the data procured from running the query for all vegetable_names.

I use the “Esri ArcGIS Layer” reader to read an .lpkx file that contains 2 different feature layers, with different geometry (lines and points) but the reader fails to read both layers. It reads only one of the layers. Anybody with the same issue?FME Desktop ESRI Edition 2022.2.2.0ArcGIS Pro 3.2.0 64bitThanks! 

I am reading two AutoCAD files and sending them through a ChangeDetector to identify the differences between files.  For my updated features, I am trying to write out the attributes to my blocks to displayy the following attributes as extended entity data:Id, Update_1,Update_2, Update_3 (all the way through Update_10)Writer Feature Type Showing all the attributes.​​​​However, when I open the drawing, the Extended Entity Data is being written as such:Block Extended Entity Data is repeated, missed, and “garbled”.Can someone give me some advice as to why this may be happening?

Is it possible to clip a Civil 3D surface using FME and then export it as a Civil 3D surface DWG file?

When I write to AGOL I get the following error message:|ERROR |Attribute(64 bit real)             : `Company_Material_Unknown' has value `1312'I’ve tried various data type for both the writer and the attribute manager before the writer.  Nothing works.  I have another AGOL writer in another place in the FMW (different data stream) and it works fine.

I am calculating measure values on a polyline from mile post signs, but we’ve found a problem with the input data.  There are a number of streets that are circles.   The street name is the same all the way around this loop, and the mileage increases clockwise around the loop, but when it gets back to the intersection, there are a few incorrectly placed mileposts.   How would I go about throwing out mileposts that change direction, such as going from increasing to decreasing, while on the same street? 

Hi, all, as the title suggests, we bought FME Server on the back of this information on the FME Website which reads "Esri’s I3S format is perfect for streaming large, heterogeneous 3D data across internet platforms. Create FME workflows to bring your 3D objects, meshes and point clouds together as a scene layer package (SLPK). This format is easy to handle and is ready to use in the cloud, on the web, or on your mobile device." Of course, we have learnt that point clouds is not yet supported. Can we get an update on what date the point clouds will be supported? Also, in the meantime, I think the FME website should be updated to more accurately reflect capability.

I have a problem writing a date field in a Filegeodatabase (open API Fgdb Writer)As soon as I enter these date fields manually, nothing is put in the Fgdb.In the attribute creator I enter @DateTimeFormat(20240101,%d-%m-%Y) so this should work.What can I do to make this work?

Hi guys, I would like to run a network analysis. I red some articles about this using FME but I got stuck. Hopefully you can help me out. Input data:Polygons representing buildings Polygons representing parks. Line road networkFor each building I want to compute whether its possible to reach a park within 300m distance using the provided network. Could you give me support in the right direction?I tried to use the MeasureExtractor and NetworkCostCalculator but did not manage until now.This image shows the general idea, walking from a building via the red line to a park in green. 

I am trying to use FeatureWriter to create tables in various different PostGIS databases. I am specifying the Database Connection (host, port, database) using attributes from the schema feature but I'm getting the following error:FeatureWriter (WriterFactory): MULTI_WRITER: No dataset was specified for MULTI_WRITER_DATASET or FeatureWriter_0_DATASET or POSTGIS_DATASETMULTI_WRITER: No dataset was specified for MULTI_WRITER_DATASET or FeatureWriter_0_DATASET or POSTGIS_DATASETIf I hardcode the database connection parameter the FeatureWriter works as expected, even with host and port still using attribute values. I have used the database attribute successfully on a FeatureReader in the same workspace so can't understand why it's not working here.Any suggestions on why this might not be working or how I could get around the problem would be much appreciated.  ThanksTom

I recently posted a question on the r/fme subreddit but am reposting here to see if I have better luck. I’m including the reddit post for context in the Original Post Contents section below.Since creating the post, I ended up joining the attributes I needed from the JSON to my transformation table but at the cost of decreased performance, see the Update to Original Post section below. Original Post ContentsDoes anyone know if there's a way to easily load attributes from a simple JSON file to be used as Parameters in an FME workspace (Workbench 2022.2)?I want to be able to alter the values in the JSON file and have the changes reflected in the FME Parameters, instead of having to manually set each parameter in FME by hand when I want to make a change.Here's a portion of the JSON file I'm using. I've tried using the JSONFeature Reader in combination with VariableSetter/VariableReader and MultiVariableSetter/MultiVariableReader to some degree of success. However, it's far from perfect, be

Hi, when I create a new feature class in an ArcSDE Geodatabase (Oracle) the field “SE_ANNO_CAD_DATA” gets created automatically. Is it possible to disable this field in the writer? I did not find anything in the documentation about this. 

HI, I have a gdb with a lot of feature classes and I need FME to search thoroug the content of each layer and give me the list of all attributes from each layer that meets certain tester requirements. I was thinking of usint Attribute Validator but the content of the gdb will be changing hence adding attributes manually to each tester is going to be very time consuming. I need FME to search thorouhg the content of each layer saved in the gdb and give me the attributes 

Hello, I have received a GEOJSON file from a data supplier, which I would like to convert into a shapefile. Unfortunately, I am not able to extract the geometries with their corresponding attributes from this file. If I use the standard reader for JSON files, I can look at all attributes in the Inspector, but I have no geometries, only an object (?). If I integrate a ListExploder after the reader, I at least have all the objects that are integrated in the file, but I only ever see the first point of the object.My question now is how I can extract both the geometries and the corresponding attributes from the file and save them in a ShapeFile or similar?I attached a small sample. Thanks a lot

I have a feature class in a file geodatabase that I need to write to a hosted feature service that has different schema. Is there a way extract the values, modify them to match the other schema values, and update the feature service?

I am using FME in ArcGIS Pro and would like to know if there is a way to set QUOTED_IDENTIFIERS_IGNORE_CASE to TRUE in the Snowflake session before copying/creating a table. Otherwise, the table is created with quotation marks around the table and column names, then ArcGIS Pro cannot recognize the table.Thanks

The connection works fine; but when I try to read data i get: Error running query: Failed to acquire a SAS token for list on /__unitystorage/schemas/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx/tables/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx/_delta_log Exception: 403: Your token is missing the required scopes for this endpoint. What is wrong? --- I am quite new to databricks. Thank you.

Hi, I would like to have attribute values in one of the attribute tables in Shape file.Attribute value should be as shown below. How do I get the 

Hi, I have simple workbench where outcome is saved as dynamic schema. Somehow, additional columns are added to attribute table of the feature classes in gdb. Any clue what is going on?