Data

Hi FME users,  The main purpose of my recent FME workflow is to GET the files from the folder from the FME server using HTTPCaller. Although the process displayed green which means the process is running correctly, the inspector showed the HTTP status code 200, which means the results are rendered in the response body (Figure 1. ) but not created successfully in the local drive. Figure 2 is the basic setup in HTTPCaller. Figure 1. FME Inspector. Figure 2. HTTP Set-up  Then, I tried another URL copied from FME API using POST, /fmerest/v3/resources/connections/Data/download/Logo/CPB_Logo.jpg, then the FME gave me the

Hi, I'm reading around 5 million rows from the 252 Excel files. I need to view the rows to delete many columns and edit values, but indexing the results is taking a long timeHow can I improve this? Thank´s

I have an AttributeManager in a custom transformer (may be part of the problem but thought I would start simple with the AttributeManager) that has the following data (correct) on the input but the name of the attribute (not the attribute values) is assigned in the output.Input Attribute “Public_Water_System_ID” with correct values and output with wrong values:Settings in the AttributeManager is as follows:For data type I’ve tried buffer (default), varchar(20), and char(20). None of the other types seemed to make sense since the values are string.Perhaps a related problem is that this attribute (“Public_Water_System_ID”) is passed as a parameter into this custom transformer

Wich versions FME desktop are compatible with pluggin Smallworld 4/5?

Hello, i’m triying to insert / delete data in a table using Geodatabase connection in the writer but it shows this error message while insert : An error occurred while attempting to store a row into the table 'FCL_EQUIP'. The error number from ArcObjects is: '-2146232832'. The error message from ArcObjects is: {ArcGIS-error creating a new feature !(BaseUserSession::Application not initialized.)} and this while delete : Error while deleting feature in the table/feature class 'FCL_EQUIP. The error number from ArcObjects is: '-2147217402'. The error message from ArcObjects is: {}All edits made during the edit session were savedA fatal error has occurred. Check the logfile above for details

Hello everyone!I am beginning this conversation with two goals in mind. First, I would like to share and discuss my new transformer OpenAIGeographicCreator, and second, we at Safe would like to see how a post of the new type, “Conversation” performs in the community. The idea is to have a way to expand conversations beyond simple “question-answer” style and have meaningful discussions among multiple participants about problems, solutions, functionality and everything FME related. Here, we could run our ideas by the whole FME community, get advice or inspiration and share our successes and even failures - together, we may be able to help.So, the story of this transformer began with @bruceharold’s idea here: 

Hello FME community, I have an issue I'm working on and can't seem to figure out the solution. I have two Excel tables. One with different kinds of certifications and the score each is given.Certification Score Certification_A 1 Certification_B 5 Certification_C 7 The second one contains Applicants with fields defining the various certifications and links to said certification. One applicant can have multiple certifications. We need to determine for each applicant which is the highest scoring certification.Applicant_ID Certification_A Cerification_B Certification_C 1  

I have a process that uses a change detector transformer to compare address data from one database and update the data in a second database based on differences in the dataset. It works great normally but the other night it updated, but I had an extra 85000 records that ended up being duplicates of existing records. Both these databases are SQL server ESRI Geodatabases and are using the same SQL server instance. What I think happened is that the database instance was failed over while the FME process was in the middle of running, which disconnected the session temporarily and when reconnected started reading records again which looks like it started reading the records from the start but still included the records that were already read in addition. Is there something I can do or set when a database is failed over in the middle of running a process to prevent this issue?

I have an Excel 365 .xlsx spreadsheet that I am trying to read into a FME 2021 workspace. When I try to read it, it gives me an error message: |ERROR |Excel Reader: Could not open file '...\input.xlsx', file is too large. Try switching to 64-bit FME, or exporting the Excel file to CSV. If the file is exported to CSV, formulas and formatting will be lost...T I cannot change the spreadsheet to a .xls, it has to remain a .xlsx. Any ideas on how to solve this?  The spreadsheet I need to read is 22mb with approximately 93,000 records.  

I have a collection of as built drawings stored as PDF’s and wanted to automate the creation of image files being used as thumbnails in a web application. I was wondering if anyone has done this before. I am currently using the Workbench 2018 PDF reader and attempting to rasterize using either ImageRasterizer or MapnikRasterizer.

I hope this post makes sense. I used a list an attribute splitter -> list exploder -> attribute creator to assign a value based on conditional criteria. I now need to filter the data using the following logic: Take the minimum “_element_index” WHERE “Review Status” (newly created attribute) has a value, else use the MIN(element_index).There would be a Group By: “Project Number”Any help would be greatly appreciated   

Is there anyway to read in attachments while using the FeatureReader transformer. I know there is an option with the ArcGIS Online Reader but I don't know my Where Clause until after certain point in my workflow. Feature Reader was working perfect until I realized I couldn't read in attachments. Any help would be great!

Hi, My workspace has an AGOL reader (reads attachments too). Features are compared to existing SDE records and new features are then processed into the SDE (photos go to our DMS). Unfortunately, all AGOL records and attachments have to be read before comparison - even with our fast internet, it still takes 5 seconds per feature (6 photo attachments). Our test dataset has 1500 records (9k photos) and the production dataset has 100k records.My idea was to read the AGOL dataset WITHOUT attachments and then use an AGOL FeatureReader to just read the new features WITH attachments, but... FeatureReader is (or at least was) unable to work with attachments.The rest of the workspace is fairly involved, so I don't believe this is a case for a WS Runner. Ideas will be much appreciated.Cheers,Mark

I wanted to run a single sql query but with multiple variable value depending on my user input (to a parameter).For Example :When I type in VEGETABLE in my user parameter I want to run “SELECT * FROM <vegetable_name>”, where I have a bunch of different values for my <vegetable_name> variable, additionally I want to join all the data procured from running the query for all vegetable_names.

I use the “Esri ArcGIS Layer” reader to read an .lpkx file that contains 2 different feature layers, with different geometry (lines and points) but the reader fails to read both layers. It reads only one of the layers. Anybody with the same issue?FME Desktop ESRI Edition 2022.2.2.0ArcGIS Pro 3.2.0 64bitThanks! 

I am reading two AutoCAD files and sending them through a ChangeDetector to identify the differences between files.  For my updated features, I am trying to write out the attributes to my blocks to displayy the following attributes as extended entity data:Id, Update_1,Update_2, Update_3 (all the way through Update_10)Writer Feature Type Showing all the attributes.​​​​However, when I open the drawing, the Extended Entity Data is being written as such:Block Extended Entity Data is repeated, missed, and “garbled”.Can someone give me some advice as to why this may be happening?

Is it possible to clip a Civil 3D surface using FME and then export it as a Civil 3D surface DWG file?

When I write to AGOL I get the following error message:|ERROR |Attribute(64 bit real)             : `Company_Material_Unknown' has value `1312'I’ve tried various data type for both the writer and the attribute manager before the writer.  Nothing works.  I have another AGOL writer in another place in the FMW (different data stream) and it works fine.

I am calculating measure values on a polyline from mile post signs, but we’ve found a problem with the input data.  There are a number of streets that are circles.   The street name is the same all the way around this loop, and the mileage increases clockwise around the loop, but when it gets back to the intersection, there are a few incorrectly placed mileposts.   How would I go about throwing out mileposts that change direction, such as going from increasing to decreasing, while on the same street? 

Hi, all, as the title suggests, we bought FME Server on the back of this information on the FME Website which reads "Esri’s I3S format is perfect for streaming large, heterogeneous 3D data across internet platforms. Create FME workflows to bring your 3D objects, meshes and point clouds together as a scene layer package (SLPK). This format is easy to handle and is ready to use in the cloud, on the web, or on your mobile device." Of course, we have learnt that point clouds is not yet supported. Can we get an update on what date the point clouds will be supported? Also, in the meantime, I think the FME website should be updated to more accurately reflect capability.

I have a problem writing a date field in a Filegeodatabase (open API Fgdb Writer)As soon as I enter these date fields manually, nothing is put in the Fgdb.In the attribute creator I enter @DateTimeFormat(20240101,%d-%m-%Y) so this should work.What can I do to make this work?

Hi guys, I would like to run a network analysis. I red some articles about this using FME but I got stuck. Hopefully you can help me out. Input data:Polygons representing buildings Polygons representing parks. Line road networkFor each building I want to compute whether its possible to reach a park within 300m distance using the provided network. Could you give me support in the right direction?I tried to use the MeasureExtractor and NetworkCostCalculator but did not manage until now.This image shows the general idea, walking from a building via the red line to a park in green. 

I am trying to use FeatureWriter to create tables in various different PostGIS databases. I am specifying the Database Connection (host, port, database) using attributes from the schema feature but I'm getting the following error:FeatureWriter (WriterFactory): MULTI_WRITER: No dataset was specified for MULTI_WRITER_DATASET or FeatureWriter_0_DATASET or POSTGIS_DATASETMULTI_WRITER: No dataset was specified for MULTI_WRITER_DATASET or FeatureWriter_0_DATASET or POSTGIS_DATASETIf I hardcode the database connection parameter the FeatureWriter works as expected, even with host and port still using attribute values. I have used the database attribute successfully on a FeatureReader in the same workspace so can't understand why it's not working here.Any suggestions on why this might not be working or how I could get around the problem would be much appreciated.  ThanksTom

I recently posted a question on the r/fme subreddit but am reposting here to see if I have better luck. I’m including the reddit post for context in the Original Post Contents section below.Since creating the post, I ended up joining the attributes I needed from the JSON to my transformation table but at the cost of decreased performance, see the Update to Original Post section below. Original Post ContentsDoes anyone know if there's a way to easily load attributes from a simple JSON file to be used as Parameters in an FME workspace (Workbench 2022.2)?I want to be able to alter the values in the JSON file and have the changes reflected in the FME Parameters, instead of having to manually set each parameter in FME by hand when I want to make a change.Here's a portion of the JSON file I'm using.

Hi, when I create a new feature class in an ArcSDE Geodatabase (Oracle) the field “SE_ANNO_CAD_DATA” gets created automatically. Is it possible to disable this field in the writer? I did not find anything in the documentation about this.