Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,703 Posts
24,707 Replies

When you subscribe we will email you when there is a new topic in this category

6703 Posts

Recently active

Most replies Most views Newest first

Problem with conversion of CityGML to json

I just would like to convert CityGML files to json files. When checking the converted json file in the FME Data Inspector, I get the errors shown below. Maybe I missed some parameters during reading/writing. Thank you for your help!These errors are shown when checking the json file:CITYJSON reader: An error occurred. FME will attempt to provide more information on the error, but this may cause the translation to be terminatedRead Metadata Feature Command caught exception: stk::ex::FatalError[0] CITYJSON reader: [json.exception.parse_error.101] parse error at line 1, column 2: syntax error while parsing value - unexpected end of input; expected '[', '{', or a literal[1] auto __cdecl STFReader::openDataSet::<lambda_45ec89e6ecf0932b901acf3bedceb848>::operator ()(void) const(C:\\code\\fme\\foundation\\framework\\engine\\reader.cpp:80) My initial CityGML file:

Auto-name Excel files

Hello,I have the following situationI made a drop_down list (User Parameters) - Choise, from which to choose a specific locality.depending on the name of the locality, I generate an excel file.I want that when I create the excel file, this file should bear the name of the locality.Ex: BACAU => BACAU.xlsx AGAS => AGAS.xslx

arnovananrooijContributor

PostGIS FeatureWriter adds extra rows

Hi,I am sending 2600 features to a PostGIS FeatureWriter. When I look in the resulting table (which was completely empty) I see 2628 rows. How is this possible?I noticed it because first I had a primary key defined and I was sure there were no duplicates in the 2600 features, but I got an primart key violation error After removing the primary key I see several duplicates.Any ideas on how to solve this? Or did I find a bug?

Point cloud to Las fails with checksum mismatch error.

Running a simple script of point cloud to Las in FME 2020 desktop. My input is five .e57 files. The script fails after writing the first Las file with the error message: E57 reader: E57 reader: An error occurred while reading. The error was 'checksum mismatch, file is corrupted (E57_ERROR_BAD_CHECKSUM)' with context 'fileName=C:\\1-Working\\GDB\\E57\\1-01-C-01_200219-0.e57 computedChecksum=10167370 storedChecksum=2581601340 page=2465744 length=4044457984' (error code = 16)FFS writer: Failed to get block of 10000 points starting at index 167600000Stored 1 feature(s) to FME feature store file `C:\\Users\\Employee\\AppData\\Local\\Temp\\wb-cache-e572las-IwHIxO\\Main_point_cloud -1 2 -1 0 5593c33571a1202057291a33f5c5400df0f2e01f.ffsupdating'Saving spatial index into file 'C:\\Users\\Employee\\AppData\\Local\\Temp\\wb-cache-e572las-IwHIxO\\Main_point_cloud -1 2 -1 0 5593c33571a1202057291a33f5c5400df0f2e01f.fsi'Finished saving spatial index into file 'C:\

PowerPointStyler Stacked Column Chart

How do I set up my data to generate a stacked bar chart? For each CURRENT_OPERATOR_ALIAS category, I have 7 bins (RATE_CLASS) that I'd like to chart, where one bar is a CURRENT_OPERATOR_ALIAS with corresponding counts (COUNT(API) attribute), but I can't seem to plot 2 categories in the PowerPointStyler.

Hi, I want to clip WMS layer using polygon shp and write it out as a pdf. Any ideas?

special characters

Hello, I'm reading data from an ORA database wicht contains - a surname: Çad?rc? - a name: ËCadõrcõ In the inspector I see these names correct with encoded utf-8when I write this information to an (different) ORA-database with Varchar2(800) the table contains: - a surname: Çadrc (wrong) - a name: ËCadõrcõWhen I put the writer items to AUTOMATIC it will give also the same outputWhen I change the TYPE in the writer from Varchar2 to NCHAR the table will contain: - a surname: Çad?rc (wrong) - a name: ËCadõrcõ what am I doing wrong and how to correct this problem?

benvkContributor

AGOL - Populate house table with oldest resident from second table

Hey, I have two tables in the ArcGIS Online space, one contains a list of houses (property_table), and the other related table contains a list of residents that reside within (resident_table).What I am trying to do is populate the property table with the AGE of the OLDEST RESIDENT inside each house. I have no idea how to do this and am seeking assistance to build a plan of attack. I have been able to add the two readers to my workspace successfully, I can do a feature joiner which proves the residents do reside within the said houses. But I don't think its actually necessary for the join for the calculation to take place.So can someone please tell me how I would find the OLDEST resident, and then insert that date of birth, and name, into the two fields in the property table?I have been staring at this for too long and my brain is not able to straighten out the issue in front of me, it should be rather straightforward :( Property Table:Resident Table:

fdwContributor

PDF writer: Document properties

Hi, We are daily updating a number of PDF's with FME for publication on our website but these files need to have the Document Properties set. Our webcare team won't allow for the pdf's to be published. So far I'm not able to achieve this.There seems to be an option with the format attribute 'pdf_document_info_metadata' but how do I format the properties in my writer?When reading a pdf which has these properties filled in, pdf_document_info_metadata is a feature type. I have tried adding this feature type to my pdf writer with the exact same schema. But no result; empty properties still.Does anyone know if writing the properties is supported and how to achieve it?

fmelizardContributor

Can I add a new layer to an existing Feature service on ArcGIS Online or ArcGIS Portal?

How to publish Covid19 data to socrata dataset without deleting columns

I created a workbench that reads oracle database view and writes to socrata dataset. I was trying different settings in the writer and now my socrata dataset is missing 4 columns. Is there anyway to create those columns while writing the data? I'm using FME 2018.

mr_fmeEnthusiast

Fill cell in Excel file based in previous information

Hi all,I have an excel file, where I need to fill in fields based on previous values. This should happen for 3 fields: total_suspects, total_positive, total_recovered, deaths. But some cells are not filled, they are empty. I need to fill in the previous amount, according to the previous date. Example: total_suspects for day 2020-04-06 3:00 is 19, but for day 2020-04-07, it is empty, so it should be 19. This same situation should continue in all empty fields in the sequence of days. This should happen for the 3 columns informed at the beginning. The problem is that this must happen grouped by name. However, each name set has the same date and different values.Look below, my situation now: Expectation: My file below:I have one sample workspace, with one sorter trasformer and one attribute creator with configuration below: My workspace run very well, but for one location (name) only. My file has many lines, and many different locations (names), and in my output file nothing happens. can

nedwatermanContributor

Extract XML from URL

Hi,I'm using a HTTPCaller to connect to an XML api service. Although I can connect and receive XML I can't create attributes from the file. I'm new to XML and don't know how to do this. I tried using an XML reader and successfully extracted the attributes, but then FME 2019.2 keeps crashing after reading the file, or reads the file and then doesn't show the reader in the workbench, so I'm hoping this will be a more robust method. I've tried using an XMLFragmenter to get the attributes, but they aren't showing - I assuming I'm missing a step somewhere. testxml.txt I've attached a test file.Thanks N

Write/Update Metadata using XMLUpdater

Hi there! I am new into the FME world and I am kinda hoping somebody can point me into the right direction. Currently I am trying to build an FME routine that will allow me to read metadata from a excel sheet (preferred format from the engineer department) and write it into a geodatabase feature class.This is how my workflow currently looks: Everything seems to work fine when it comes to updating the metadata fields (Title, Summary, Description, etc.) but when it comes to writing new values (writing in a blank field) the routine runs successfully but no values are being added to the feature class metadata. This is how my XML Updater looks: In this particular instance the feature class has a title so the FME routine is updating to the new title located in the Excel spreadsheet. That being said the Summary and the Credits metadata fields are empty in the original feature class and remain empty after the process is completed. I already tried all different Update

How to use FME as a tool to translate Geodata into minecraft?

Hi there, I am a new user to FME and therefore not so familiar with the interface and functionalities of FME desktop. I downloaded the software as I read in some articles that you could translate Cadastral property data and building height data into Minecraft with the help of FME. I am currently working on a project in Minecraft where the aims are to build the whole earth with human structure into the game. Even though the project has 100,000 users already participating, it is simply impossible to recreate everything by hand. If it is possible to load entire cities into Minecraft, it would help a lot. I would like to know which data I need, how I should utilize it in FME, and how the conversion process works to recreate the shells of buildings in Minecraft. Thanks in advance!

Best way to write to specific CAD layers using Generic Writer

I am in the process of converting one of our large workspaces that looked at the saved extents of an ArcGIS Map (.MXD) file and using a CAD seed file, wrote out an AutoCAD .DWG file. The old/original workspace wrote data out to specific layers in that CAD file. It also applied labeling, blocks w/rotations, etc... The end result was a decent looking CAD .dwg that our designers could use as a starting point for a new design project.My goal is to transition this to an FME Server App and make it a multi-purpose process that would use the Generic Writer and would allow users to select an extent within the FME Server App map and export to the same type of a CAD file, but also if needed, export out a KML, or other formats.What's the best way to accomplish this? (Writing features out to specific layers withing the CAD .dwg)

Geocoder attributes no longer available

After updating to FME 2019.1, I've found that the GoogleGeocoder transformer no longer works. I've been attempting to use the Geocoder transformer, but it seems that a lot of the attributes that were returned with the GoogleGeocoder are no longer returned with the Geocoder. This is causing issues with existing workbenches that rely on those attributes.Has anyone else encountered this? Is there a workaround for the Geocoder transformer to have it return all of the original fields, or has anyone been able to fix the GoogleGeocoder to work with FME 2019.1? It was suggested to use regrex to parse the individual fields, however since addresses aren't standardized it wouldn't be feasible to do so.

pass java parameters without env variable

Hello!I found a way to configure a JDBC connection using env variable but unfortunately, it breaks another software configuration I have on the same Windows machine. My goal is to set the following configuration: JAVA_TOOL_OPTIONS=-Djava.security.auth.login.config=...I felt like it was possible to directly configure the attached JRE (like in jre\\lib\\security\\java.security file) but it doesn't seam to work. Since I am running the fmeworkbench.exe, how can I pass the configuration to the program? Is there a config file which is read (seams to be the case for the server)?Many thanks for helping and wish you a great day!Christophe

How do I set the Feature Type as a published parameter in the FeatureReader with a Microstation DGN file

HiThis is a problem which has bugged me for years. I cannot work out how to set the feature type as a published parameter in a FeatureReader transformer that is reading in a Microstation DGN file. I have a number of different combinations of the following settings and none seem to work. All I get is one record coming out of the Initiator Port and the DGN file data does not come out of any of the ports. Can anyone help me with this?I am on FME Desktop 2019.1.Thanks!

I am having a problem reading an ArcGIS Server feature service using a FeatureReader

This service used to read just fine, but now throws the following error: "Failed to obtain any schemas from reader 'ARCGISFEATURES' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more informationFailed to read schema features from dataset 'https://apps.fs.usda.gov/arcx/rest/services/EDW/EDW_FireOccurrence_01/MapServer' using the 'ARCGISFEATURES' readerThe dataset 'https://apps.fs.usda.gov/arcx/rest/services/EDW/EDW_FireOccurrence_01/MapServer' was closed successfully" The strange thing is, this service reads just fine with a regular Reader, but I need to use a FeatureReader so that I can read in a bounding box through the initiator. It looks like the error occurs when setting the "Feature Types to Read" parameter.The service is public, so hopefully you can take a look and see what's happening. I am experiencing the issue in FME

How can I merge identical sheets in excel to 1 table with diffent colomns?

Hello,I have a excel with al lot of sheets per region (500 different names). All have the same form.On each sheet in different rows, I have measurements for each day. (Timestamp : 365 d)The name is in the sheet (yellow) and also in the sheetname (tab).Now I want a table where for each day, I have a new colomn per region. Example for 3 regions is attached, also how the result should look like.Thanks for any tip!

How to convert Cityengine shape file into citygml using FME, Also i want to convert into LOD2 model with roof texture, terrain and wall surfaces. Please do needful.

@virtualcitymatt

Trouble reading Excel files into my workbench

Hello, I am struggling with reading Excel files into my workbench. I built my workbench based on an Excel file with this format. When adding the reader I set the 'field names row' at 3, so the names in row 3 are used as column headers in FME. I want to use my workbench for other files as well. These files have the same format. Only the information from row 4 will be different. So I created two user parameters witin my workbench:- Input File- Output Directory If I open my workbench and run the translation I can fill in the user parameters: When I choose the original file which I used to create the workbench, all goes well. But when I choose another file, I only get missing values:I even made a copy of the original file, so it is exactly the same document with only a different file name. But even then I get missing values. Can anyone explain to me what I need to change in my settings to overcome this?Has the red indication in the User Parameters window something to do with it?

franco69Contributor

AUTOCAD Format Attributes or Transformer?

Hi Guys I don't know if i should open a new task but i do so now. I have 2 short answers Reader: dwgmy output dwg should be rotated (another north direction) and scaled to 1:1000are there format attributes for that or have i handle this with Transformer (Scaler,....) thx and GreetzFranco

louielou1234Participant

Max Features to Read in name only?

Okay newbie here (sorry in advance)--so I plopped an MSSQL reader into my workspace and set the max count for each feature paramater to read to 10. And indeed, the cache count stops at 10. However, in the log I can see that it is still going to town on 4 million spatial records in the SQL DB and the bucket keeps filling up even after it reaches the max 10 count. In other words, setting the max features to 10, 100, or 1,000,000 takes exactly the same amount of time (and resources) for the workspace to complete its processing. What am I doing wrong here? THANKS!

1
...
67
68
69
70
71
72
73
...
269

Page 70 / 269

Badge winners

bwnhas earned the badge Enchanted by Attributes
magdahirschhas earned the badge Welcome Back
jpgapdfhas earned the badge Student (Grey)
jpgapdfhas earned the badge Spanish Speaker
jpgapdfhas earned the badge English Speaker

Show all badges

29,733: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK