Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,708 Posts
24,713 Replies

When you subscribe we will email you when there is a new topic in this category

6708 Posts

Recently active

Most replies Most views Newest first

jeroen_hackContributor

Combining two tables without a common field

Hello FME community, I have an issue I'm working on and can't seem to figure out the solution. I have two Excel tables. One with different kinds of certifications and the score each is given.Certification Score Certification_A 1 Certification_B 5 Certification_C 7 The second one contains Applicants with fields defining the various certifications and links to said certification. One applicant can have multiple certifications. We need to determine for each applicant which is the highest scoring certification.Applicant_ID Certification_A Cerification_B Certification_C 1 URL to file 2 URL to file 3 URL to file URL to file In the second table I want to add the scores and then determine the highest score for each row (this i can do in a new field with the max(Value1, Value2 etc) function) and write out the applicant_id, the highest scoring certification name, it's URL and the score.Can anyone give me some pointers how i can solve this case?T

salahedContributor

Error '-2146232832' while insert or delete

Hello, i’m triying to insert / delete data in a table using Geodatabase connection in the writer but it shows this error message while insert : An error occurred while attempting to store a row into the table 'FCL_EQUIP'. The error number from ArcObjects is: '-2146232832'. The error message from ArcObjects is: {ArcGIS-error creating a new feature !(BaseUserSession::Application not initialized.)} and this while delete : Error while deleting feature in the table/feature class 'FCL_EQUIP. The error number from ArcObjects is: '-2147217402'. The error message from ArcObjects is: {}All edits made during the edit session were savedA fatal error has occurred. Check the logfile above for details

dmitribaghSafer

The AI Geographer: Converting Text to Geographic Features

Hello everyone!I am beginning this conversation with two goals in mind. First, I would like to share and discuss my new transformer OpenAIGeographicCreator, and second, we at Safe would like to see how a post of the new type, “Conversation” performs in the community. The idea is to have a way to expand conversations beyond simple “question-answer” style and have meaningful discussions among multiple participants about problems, solutions, functionality and everything FME related. Here, we could run our ideas by the whole FME community, get advice or inspiration and share our successes and even failures - together, we may be able to help.So, the story of this transformer began with @bruceharold’s idea here: I quickly made a working prototype and realized that OpenAI can really create geometries in the form of GeoJSON from a free-form text description of a location. For example, we can ask the API to give us a center point and a bounding box of Vancouver or a much smaller town in Finlan

jasoncContributor

Nightly Change Detector Process inserted more records than Expected

I have a process that uses a change detector transformer to compare address data from one database and update the data in a second database based on differences in the dataset. It works great normally but the other night it updated, but I had an extra 85000 records that ended up being duplicates of existing records. Both these databases are SQL server ESRI Geodatabases and are using the same SQL server instance. What I think happened is that the database instance was failed over while the FME process was in the middle of running, which disconnected the session temporarily and when reconnected started reading records again which looks like it started reading the records from the start but still included the records that were already read in addition. Is there something I can do or set when a database is failed over in the middle of running a process to prevent this issue?

vxn43Supporter

Excel file too large to read (error)

I have an Excel 365 .xlsx spreadsheet that I am trying to read into a FME 2021 workspace. When I try to read it, it gives me an error message: |ERROR |Excel Reader: Could not open file '...\input.xlsx', file is too large. Try switching to 64-bit FME, or exporting the Excel file to CSV. If the file is exported to CSV, formulas and formatting will be lost...T I cannot change the spreadsheet to a .xls, it has to remain a .xlsx. Any ideas on how to solve this? The spreadsheet I need to read is 22mb with approximately 93,000 records.

Convert PDF to image file (jpg, png, tiff)

I have a collection of as built drawings stored as PDF’s and wanted to automate the creation of image files being used as thumbnails in a web application. I was wondering if anyone has done this before. I am currently using the Workbench 2018 PDF reader and attempting to rasterize using either ImageRasterizer or MapnikRasterizer.

jamesovalleContributor

Min Value where another attribute has a value

I hope this post makes sense. I used a list an attribute splitter -> list exploder -> attribute creator to assign a value based on conditional criteria. I now need to filter the data using the following logic: Take the minimum “_element_index” WHERE “Review Status” (newly created attribute) has a value, else use the MIN(element_index).There would be a Group By: “Project Number”Any help would be greatly appreciated

Read ArcGIS Online Attachments using Feature Reader

Is there anyway to read in attachments while using the FeatureReader transformer. I know there is an option with the ArcGIS Online Reader but I don't know my Where Clause until after certain point in my workflow. Feature Reader was working perfect until I realized I couldn't read in attachments. Any help would be great!

Does FeatureReader work with AGOL attachments yet?

Hi, My workspace has an AGOL reader (reads attachments too). Features are compared to existing SDE records and new features are then processed into the SDE (photos go to our DMS). Unfortunately, all AGOL records and attachments have to be read before comparison - even with our fast internet, it still takes 5 seconds per feature (6 photo attachments). Our test dataset has 1500 records (9k photos) and the production dataset has 100k records.My idea was to read the AGOL dataset WITHOUT attachments and then use an AGOL FeatureReader to just read the new features WITH attachments, but... FeatureReader is (or at least was) unable to work with attachments.The rest of the workspace is fairly involved, so I don't believe this is a case for a WS Runner. Ideas will be much appreciated.Cheers,Mark

kjoshipuParticipant

Running the same query multiple times with different variables leading off one input user parameter and joining them

I wanted to run a single sql query but with multiple variable value depending on my user input (to a parameter).For Example :When I type in VEGETABLE in my user parameter I want to run “SELECT * FROM <vegetable_name>”, where I have a bunch of different values for my <vegetable_name> variable, additionally I want to join all the data procured from running the query for all vegetable_names.

charisphParticipant

LPKX File with multiple feature layers

I use the “Esri ArcGIS Layer” reader to read an .lpkx file that contains 2 different feature layers, with different geometry (lines and points) but the reader fails to read both layers. It reads only one of the layers. Anybody with the same issue?FME Desktop ESRI Edition 2022.2.2.0ArcGIS Pro 3.2.0 64bitThanks!

gmbutler2Contributor

AutoCAD Extended Entity Data not writing out correctly.

I am reading two AutoCAD files and sending them through a ChangeDetector to identify the differences between files. For my updated features, I am trying to write out the attributes to my blocks to displayy the following attributes as extended entity data:Id, Update_1,Update_2, Update_3 (all the way through Update_10)Writer Feature Type Showing all the attributes.However, when I open the drawing, the Extended Entity Data is being written as such:Block Extended Entity Data is repeated, missed, and “garbled”.Can someone give me some advice as to why this may be happening?

gis.analystContributor

clipping Civil 3D surface

Is it possible to clip a Civil 3D surface using FME and then export it as a Civil 3D surface DWG file?

neaContributor

Not able to write to AGOL

When I write to AGOL I get the following error message:|ERROR |Attribute(64 bit real) : `Company_Material_Unknown' has value `1312'I’ve tried various data type for both the writer and the attribute manager before the writer. Nothing works. I have another AGOL writer in another place in the FMW (different data stream) and it works fine.

matthewbContributor

How to find and remove measure values that change direction?

I am calculating measure values on a polyline from mile post signs, but we’ve found a problem with the input data. There are a number of streets that are circles. The street name is the same all the way around this loop, and the mileage increases clockwise around the loop, but when it gets back to the intersection, there are a few incorrectly placed mileposts. How would I go about throwing out mileposts that change direction, such as going from increasing to decreasing, while on the same street?

swit012Participant

When will I3S Writer support point clouds?

Hi, all, as the title suggests, we bought FME Server on the back of this information on the FME Website which reads "Esri’s I3S format is perfect for streaming large, heterogeneous 3D data across internet platforms. Create FME workflows to bring your 3D objects, meshes and point clouds together as a scene layer package (SLPK). This format is easy to handle and is ready to use in the cloud, on the web, or on your mobile device." Of course, we have learnt that point clouds is not yet supported. Can we get an update on what date the point clouds will be supported? Also, in the meantime, I think the FME website should be updated to more accurately reflect capability.

fme_dr22_forumContributor

Problem with Date fielf in Open API Writer (Fgdb()

I have a problem writing a date field in a Filegeodatabase (open API Fgdb Writer)As soon as I enter these date fields manually, nothing is put in the Fgdb.In the attribute creator I enter @DateTimeFormat(20240101,%d-%m-%Y) so this should work.What can I do to make this work?

lambertusEnthusiast

Get network analysis working

Hi guys, I would like to run a network analysis. I red some articles about this using FME but I got stuck. Hopefully you can help me out. Input data:Polygons representing buildings Polygons representing parks. Line road networkFor each building I want to compute whether its possible to reach a park within 300m distance using the provided network. Could you give me support in the right direction?I tried to use the MeasureExtractor and NetworkCostCalculator but did not manage until now.This image shows the general idea, walking from a building via the red line to a park in green.

tomcolleyContributor

FeatureWriter cannot get database from attribute

I am trying to use FeatureWriter to create tables in various different PostGIS databases. I am specifying the Database Connection (host, port, database) using attributes from the schema feature but I'm getting the following error:FeatureWriter (WriterFactory): MULTI_WRITER: No dataset was specified for MULTI_WRITER_DATASET or FeatureWriter_0_DATASET or POSTGIS_DATASETMULTI_WRITER: No dataset was specified for MULTI_WRITER_DATASET or FeatureWriter_0_DATASET or POSTGIS_DATASETIf I hardcode the database connection parameter the FeatureWriter works as expected, even with host and port still using attribute values. I have used the database attribute successfully on a FeatureReader in the same workspace so can't understand why it's not working here.Any suggestions on why this might not be working or how I could get around the problem would be much appreciated. ThanksTom

coopergoodmanContributor

Load JSON Attributes as Parameters

I recently posted a question on the r/fme subreddit but am reposting here to see if I have better luck. I’m including the reddit post for context in the Original Post Contents section below.Since creating the post, I ended up joining the attributes I needed from the JSON to my transformation table but at the cost of decreased performance, see the Update to Original Post section below. Original Post ContentsDoes anyone know if there's a way to easily load attributes from a simple JSON file to be used as Parameters in an FME workspace (Workbench 2022.2)?I want to be able to alter the values in the JSON file and have the changes reflected in the FME Parameters, instead of having to manually set each parameter in FME by hand when I want to make a change.Here's a portion of the JSON file I'm using. I've tried using the JSONFeature Reader in combination with VariableSetter/VariableReader and MultiVariableSetter/MultiVariableReader to some degree of success. However, it's far from perfect, be

pflegpetContributor

ArcSDE Writer SE_ANNO_CAD_DATA field

Hi, when I create a new feature class in an ArcSDE Geodatabase (Oracle) the field “SE_ANNO_CAD_DATA” gets created automatically. Is it possible to disable this field in the writer? I did not find anything in the documentation about this.

marta.podsiadContributor

Find attributes that meet the tester requirement

HI, I have a gdb with a lot of feature classes and I need FME to search thoroug the content of each layer and give me the list of all attributes from each layer that meets certain tester requirements. I was thinking of usint Attribute Validator but the content of the gdb will be changing hence adding attributes manually to each tester is going to be very time consuming. I need FME to search thorouhg the content of each layer saved in the gdb and give me the attributes

alfonsContributor

JSON into shape?

Hello, I have received a GEOJSON file from a data supplier, which I would like to convert into a shapefile. Unfortunately, I am not able to extract the geometries with their corresponding attributes from this file. If I use the standard reader for JSON files, I can look at all attributes in the Inspector, but I have no geometries, only an object (?). If I integrate a ListExploder after the reader, I at least have all the objects that are integrated in the file, but I only ever see the first point of the object.My question now is how I can extract both the geometries and the corresponding attributes from the file and save them in a ShapeFile or similar?I attached a small sample. Thanks a lot

shilpakParticipant

Hi there, Could I please have an update on if the I3S writer support point clouds after the release of 2023.1.1? If not then could I please have an update on the timeframe on this? Thanks, Shilpa

Hi there, Could I please have an update on if the I3S writer support point clouds after the release of 2023.1.1? If not then could I please have an update on the timeframe on this? Thanks, Shilpa

nicholsbContributor

Update Data From Different Schema

I have a feature class in a file geodatabase that I need to write to a hosted feature service that has different schema. Is there a way extract the values, modify them to match the other schema values, and update the feature service?

1
...
16
17
18
19
20
21
22
...
269

Page 19 / 269

Badge winners

stephaniemcphiehas earned the badge Teacher (Grey)
_jacques_has earned the badge Socializer (Engager)
tlazarukhas earned the badge Welcome Back
nickblakenburghas earned the badge Welcome Back
skreajohanhas earned the badge Welcome Back

Show all badges

29,744: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK