- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,701 Posts
24,706 Replies

When you subscribe we will email you when there is a new topic in this category

6701 Posts

Recently active

Most replies Most views Newest first

tfsrichard

asked in Data

ArcGIS Server kmz to file?

Anybody know how to pull down e.g. https://sampleserver6.arcgisonline.com/arcgis/rest/services/Census/MapServer/3/query?where=1%3D1&text=&objectIds=&time=&geometry=&geometryType=esriGeometryEnvelope&inSR=&spatialRel=esriSpatialRelIntersects&relationParam=&outFields=STATE_NAME&returnGeometry=true&returnTrueCurves=false&maxAllowableOffset=&geometryPrecision=&outSR=&having=&returnIdsOnly=false&returnCountOnly=false&orderByFields=&groupByFieldsForStatistics=&outStatistics=&returnZ=false&returnM=false&gdbVersion=&historicMoment=&returnDistinctValues=false&resultOffset=&resultRecordCount=&queryByDistance=&returnExtentOnly=false&datumTransformation=&parameterValues=&rangeValues=&quantizationParameters=&f=kmz as a kmz file in FME?Works through the browser but I'm unable to get kml feature reader or http Caller to work successfully as a file. My resultant f

4 years ago

tfsrichard

asked in Data

Python Exception : 502 Server Error: Bad Gateway for url

This is being raised when using an Esri ArcGIS Portal Service Feature Writer. 24,000 features out of 94,000 are successfully written before this is raised by FME Desktop 2019.1.00

4 years ago

bjornohlsson

asked in Data

Copy and Convert dwg:s to another version into another folder

Hello FME Community! I´m looking to read AutoCAD Civil 3D files from a folder and convert them to another version ex Release2013 into another folder. I´ve understood that you should use write AutoCAD DWG/DWF, since there is no Civil 3D writer. However you can´t select a folder to write to, only specific file destination? Is there another way around this? I tried taking another route, by using "Fanout Dataset" on the Writer. Which kinda solved the folder issue, but the created file got the same result as below. Also.. When I simply try to overwrite an identical dwg file with another dwg file to get the desired version, the new file lose everything that was in it and instead only gets a layer named surface. Does anyone know how to resolve this? I simply want to copy dwg files and write them identically into a new folder, but in version Release 2013/AC1027. Any form of hint is greatly appreciated!

4 years ago

georgefloros

asked in Data

FME Failure to read IFC geometries

Hello,I am trying to open IFC 2X3 files of 2MB size that have been exported from Aecosim and FME 2019.0 returns an error. or returns only the semantics of the IFC.I am able to open successfully other IFC files that were created some months ago, so this is quite unexpected considering I have not changed the parameters that I was always using. As I suspect this is quite an abstract question and testing with the model would be necessary, would it possible for a colleague of FME to assist due to data confidentiality issues?Of course, any advice is greatly appreciated. Thank you for your time. Kind regards, George Floros

4 years ago

thiru

asked in Data

Excel writer - overcome maximum row limit

Hi, I have hit the maximum row limit for an excel spreadsheet with the excel output writer (1,048,576 rows). Is there an easy option to overflow the rows into another spreadsheet?Should I use a row counter and tester to overflow the data to another spreadsheet?

4 years ago

rbeerak

asked in Data

How to run postgresql script (psql -f file_with_sql.sql) in SQL executor

I want to run bunch of postgreSQL SQL's through a file using psql command.To check whether psql works in SQLExecutor, I tried putting below statement SQL executor.psql -c 'SELECT * FROM testdb.test'; However, I got below error.psql -c 'SELECT * FROM testdb.test';'): 'ERROR: syntax error at or near "psql"LINE 3: psql -c 'SELECT * FROM testdb.test; ^'A fatal error has occurred. Check the logfile above for details Can you please help.

4 years ago

cable

asked in Data

Translating from SHP to Oracle Spatial Object table results in bad geometries.

I am fairly new to FME and I am attempting some of my first translations from SHP files to Oracle Spatial Tables. Everything completes successfully apart from the following errors I get several times through the translation:BADNEWS: An error occurred while fetching from query `SELECT table_name, column_name, DimInfo, SRID FROM USER_SDO_GEOM_METADATA' : OCI_NO_DATA (ocistmt.cpp:663)I get additional errors when publishing after writing the features to the DB:118904) Invalid geometry for component view V_STREETCTR_LN, FID 104594211, CID 1, and LTT_ID 0 - No geometry was produced, probably because of a mismatch of G3E_COMPONENT.G3E_GEOMETRYTYPE and the actual geometry, or because of an un-supported SDO_GType.I have tried this across multiple features and run into the same problems each time.Has anyone run into these issues translating from SHP to Oracle using FME?Sample Workspace:Log:

5 years ago

juliusngeh

asked in Data

I was wondering what is the best way to input base distinguish name(DN) to pull out all users from an organization using LDAP tranformer in FME 2018.1

I am using LDAP/Active Directory (Tech Preview) Transformer to access users for an entire organisation. When I use DN as ou=Users,ou=branchname, ou=departmentname,ou=Department,DC=domain,dc=domainname=ca, i get users listed from that branch only. However, I am interested in pulling out users from the whole organization which has many departments and branches. Any help is appreciated.

5 years ago

gunea

asked in Data

Split CityGML dataset by location

Hi,I have a very large CityGML dataset consisting of millions of features. I would like to split this into smaller datasets so that each dataset contains at most a few hundred features, grouped by location (eg, possibly turning each city block into a separate CityGML file). The goal is to turn each CityGML dataset into a Cesium 3D Tileset :CityGML -> [CityGML] -> [B3DM]Any help would be appreciated. Thanks!

5 years ago

aquerisoft

asked in Data

Creating FGDB schema using xls

Greetings,I am trying to create an FGDB empty geodatabase with feature datasets, feature classes & attributes. I have all these information stored in a xls file, I want to read this xls and create the FGDB accordingly. If anyone has a workflow, please share. Thanks in Advance.

5 years ago

joe_gerner

asked in Data

Extract Layers from multiple DXF Files and store it in new File

Hi,I have a lot of DXF Files in different folders. The DXF files have all the same layers.I don´t need every layer of the files for my work. So I want to read every DXF file, filter the layers which I need, summarize them to different groups and store them in a new file.How can I built such a workbench?Thanks and best regards.

5 years ago

xtian79Contributor

asked in Data

Insert GUID into a Geodatabase

Is there any transformer that help me to change from any of the python valid formats for GUIDs to the arcpy valid format to insert it in the geodatabase?The valid formats from python are:{00010203-0405-0607-0809-0a0b0c0d0e0f}00010203-0405-0607-0809-0a0b0c0d0e0f000102030405060708090a0b0c0d0e0f{000102030405060708090a0b0c0d0e0f}the valid format received by the geodatabase is:{00010203-0405-0607-0809-0a0b0c0d0e0f} thanks!!

5 years ago

hlouieContributor

asked in Data

Today is 3rd Friday this month

Today is 2019-SEP-20%Y = 2019 / Year%b = Sep / Month%a = Fri / Day Name%d = 20 / Day%u = 37 / Week of Year??? = 3 (3rd Friday of September)What I'm trying to find this is the 3rd Friday this month?ie2019-SEP-06 is the 1st Friday of September2019-SEP-13 is the 2nd Friday of September2019-SEP-30 is the 3rd Friday of September2019-SEP-27 is the 4th Friday of September

5 years ago

victorddt

asked in Data

Excel: read schema via user parameter

I need to read an Excel spreadsheet. I use user defined parameters to set a filename and a sheet name.This is a simplified workflow:This is a parameter I use: and this is schema settings for FeatureReader It gives me the following error: Here is my test example

5 years ago

cool-guy-samuel

asked in Data

Filter workspace output in FME Server Automations

Hello, I am new to FME Server and would like to know if there is a way to filter the output of a workbench with automatons? I my case i have two Schedule triggers that run a workspace. When the workspace if finished it updates a Excel file on a network drive. Now I would like to filter the contents in the Excel file so that i send an email to one person or another depending on what values are in the updated Excel. IS this possible with automatons?

5 years ago

garyb

asked in Data

AutoCAD DWG layer and spatial indexes

We're having significant performance issues with Xref drawings created by FME. In AutoCAD there are options in the "Save As" dialog to allow the drawing to be saved with layer and spatial indexes, but I can't find a way to set this in the DWG or Map OD writers in FME. Is this available somewhere or simply not possible with FME 2018? If it turns out this is not possible in the currently available writers, then as a work -around, if I save the template drawing with layer and spatial indexes, will this carry through to the drawings created by the writer in my workspace? Thanks,Gary

5 years ago

francisContributor

asked in Data

change user that runs job in web interface

Hi Folks,I understand that the jobs on FME Server (v. 2018.1.1 - Build 18567 - win32 ) are executed with the user that uploaded/published the workbench to the server. We work with active directory on FME Server. So some people have rights to publish and schedule jobs on FME server.Where can you easily change the user that runs/executed that job in the web interface of FME Server?We also configured the fme engine service runs with a specific user with access to certain network drives. Does it mean that this access is only used in the workbenches that were uploaded on FME Server with that specific user account we configured for the engine service?Thanks for sharing your knowledge,Francis

5 years ago

patrick.gressContributor

asked in Data

Direct Database Write with multiple FeatureReaders as source

I am trying to read from two large csv files with one FeatureReader for each file. Each FeatureReader is connected to a separate FeatureWriter to write to a Postgres database. I experience the problem that all data is cached first and then delivered to the writer, which will eventually exceed my memory. Since there are no transformers in between I do not now how to solve this issue. I experienced this problems in the past when I used ordinary writers, but never with a FeatureWriter, so I guess it has something to do with the usage of FeatureReader.

Hi Suddenly that the FME can't load the CSV file.When I select the csv file as input of the reader, there is exclamation mark on the Parameter. I checked the parameter is fine (delimiter, fields name, data start line) as the preview also look fine.But the "OK" button can't be clicked. Anyone know what is wrong? FYI, I can open the file normally with excel. I'm using FME Workbench 2018.

5 years ago

andreasb

asked in Data

Trying to read formulas with information on different sheets and with formulas in a dynamic table in Excel

Dear people,I have an excel file which contains a dynamic table, in this table there are formulas referencing to parameters on another sheet. Without going into detail, there needs to be a recalculation of certain coordinates. So far i was able to get an excel sheet with the extracted coordinates into the right order and structure. At this point I just want to write away this coordinates into the excel file dynamic table and let excel do the calculations so i can use these new coordinates further on into my module. So the problems i have are: 1) How do i write away the data into a dynamic table? Now it just puts my data underneath the table...2) Is it possible for FME to get the values of parameters which are written on other sheets but in the same excel file to do this calculations (also the sheets don't look the same, different columns etc.) Any ideas that can put my in the right direction will be greatly appreciated, If you need any further info, just let me know, I hope you peo

5 years ago

iewContributor

asked in Data

Microstation level names are different when read in FME

I have come across some examples where FME 'appears' to change the names of levels which are read in from a dgn file. When viewed in Microstation and Bentley View (v8) features will be on a level called 'UT-UT-CAT_Survey_Underground_Unknown' but FME says these features come from a level called 'AR-AR-CEILING FINISH-Z'.What is FME reading to get this alternative level name?

5 years ago

chaitanyajallur

asked in Data

overlay raster over the 3d Building citygml

I have a solar potential raster file which shows the solar potential on each building pixel wise at 0.5m resolution and no data in the rest of the area. I want to show that potential map on top of my 3d Building citygml. is there any way to overlay the raster over the 3d buildings.

5 years ago

helmoet

asked in Data

How does FME Server get its values for Shared folders for transformers

Hi,When a job is run on our FME Server system, I see this list of shared folders for formats, transformers, coordinate systems and coordinate system exceptions:How does FME Server determine these folders? Which user is used? Does it depend on any user logged in onto the server? Is it documented somewhere?Thankx for any answer.

5 years ago

cheffing

asked in Data

Error "Unable to open log file"

I often get this error, while the Workspace-Runner was started with new parameters. Reducing the log-level did not help Any idea how to fix this? I found no comparable community-Item .. I am calling a Workspace-Runner within the project. The workspace is called thousends of times. The calling workspace and the called one work each into their own log-Files. In this example 954 of 1461 calls crashed. In the logfile of the called wsp there are now errors mentionend.Many workspace-calls crash because the newly initialized workspace can't access the logfile because the last call has not yet closed it.This is the error description:I would like to use the option with concurrent processes, but it increases the error rate.The called wsp has one logger configured like this:What else is needed to give you an idea of the problem?Looking forward to a solutiion,Christoph

5 years ago

mcgregrrContributor

asked in Data

How to transpose an excel sheet, but only a couple of columns.

I have a logger output excel spreadsheet where the easting, northing, height, and sensor value are in one column but I need them each to be an independent column. So I need to add four new columns to the excel and populate them from the one column while leaving the loggercode and dateutcdate alone.

5 years ago

Page 99 / 269

Badge winners

guygurhas earned the badge Student (Grey)
jerhas earned the badge Welcome Back
niall_mchas earned the badge FME Form Basic Training
will.jones4has earned the badge Welcome Back
will.jones4has earned the badge FME Form Basic Training

Show all badges

29,728: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.