- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,819 Posts
25,117 Replies

When you subscribe we will email you when there is a new topic in this category

6819 Posts

Create sharepoint List if not exist

Hello, I would like to write some data from my statisticscalculator to a sharepoint list. If the list with the autocad input name does not exist, it should create a new list with the same name as the autocad input. After Running my current workspace it tells me the following:Cannot find a matching schema named 'C:\Cloud\Sync\_Projecten\FME\Inwerken Progress Checker/Input\Fme Generated\Karteringen&Areas.dwg' in the known set of schemas: ''. Known schema sources are: 'SHAREPOINT_2'. Please verify writer feature type configuration.Python Exception <KeyError>: 'C:\\Cloud\\Sync\\_Projecten\\FME\\Inwerken Progress Checker/Input\\Fme Generated\\Karteringen&Areas.dwg'A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for details I am confused as to why it it wont create a new one. My writer has been set up like this: my Current workspace looks like this T

Dynamically Create FileGeodatabase output?

I have a input file geodatabase that just has points. The workbench first uses the file name extractor transformer to get info on the input file. I use the results from the file name extractor to build out the output file path because I want it to be dynamic. For ExampleInput: C:/Temp/Input.gdbOutput: C:/Temp/Output.gdb (Dynamically created based on the file dir of the Input, name would also be generated)On the output file geodatabase destination fanout directory I put in the user param "OutputDir" that is blank to start but filled out by an attributeCreator that overwrites the value after the file name extractor transformer runs, same for the output filename but it does not seem to work dynamically and the value must be hardcored in the writer to work?

Trying to use the UpdateDetector to download new Attachments in AGOL

Hi all,I am trying to find a solution that will allow me to query a record in AGOL and compare the attachment globalID to the local attachment globalID. Ideally, I want to either keep the existing photo in our system as it is the same as online or download a replaced photo or download only any added images to the record.Using the updatedetector is the obvious way. I have tried to explode the attachment list etc. and even make the globalID populate another field for comparison but I get nowhere.A few things about the jobs being audited via collector.the file name isn't processed until fme brings inhouse so I cannot compare via filename only.The user may add additional photos at a later date or may delete the existing attachment only to replace with a new one. In that case, they have the same name.Any help and suggestions would be appreciated,Thanks all.

5 years ago

dlindner01

asked in Data

looking for a way to write csv to wlas format

FME has a WLAS reader, but i do not see a WLAS writer. Will FME be developing this in the near future? and if not, can you suggest a workflow for transforming a csv file to a wlas file format? thank you!Dan

I am having massive problem in the time taken for a workbench to read an FGDB.Is there a way (or a different reader) which can speed this up? It's laughably slow at the moment and completely unusable and this is before I've even done anything with a clipper transformer.

5 years ago

zubairsm

asked in Data

Georeference tif raster using sup file

Hello friends,I am stuck at as to how to determine parameters to do a georeference using transformer Rastergeoreference.Please see attach sup file (renamed it to .txt). What I understood (I maybe wrong) is the parameter LSR_CAMERA is the center point and OPK_LSR is the rotation (3 values in radians ) but I dont know how to convert into degrees ( 1 value). Basically what I need is the following parameter to do a georeferenceBy Point and AngleXY Upper Left CoordinateXY cell spacingRotation (Degrees) Appreciate your help

150

5 years ago

mhabContributor

asked in Data

Esri SDE writer: How to use it compatible for SDE/Oracle and SDE/Postgresql

I have a workflow which writes data to Esri SDE (Enterprise Geodatabase) via the Geodatabase Writer.It is dynamic and reads schema definition from a CSV file. In the Geodatabase the target schema is already defined at FME write time. It is created beforehand in ArcCatalog by importing an XML workspace document.This workflow produces compatible results for Personal GeoDB, FileGDB and SDE with identically configured writers for MDB, FileGDB and SDE.Up to now I used SDE based on SQL Server or ORACLE. So far so good. Now my problems start when I try the same workflow on an SDE based on Postgresql.The symptoms I notice are:1) In ArcCatalog: After Import of the XML workspace document all Table names are as expected (mixed case) but all column names are converted to lower case in contradiction to what happens on ORACLE or other environments.2) Writing data gives No WARNING, NO ERROR not any hint something went wrong but all columns are empty After studying Esri SDE Postgresql docu this is no

230

5 years ago

jhu_20Contributor

asked in Data

Possible file path or filename problems for FME Server

I received the following error message when running the job on FME server (2018.1). But this problem does not happen when running on FME desktop (2018.1). Any suggestions ? I suspect that the problem may be the path reading issue for FME Server. The filename and path works when checking in window explorer. Thank in advance for all help.Error in the Kingdom Well Reader engine: The file could not be found.: G:\\SMT\\1 Production Projects\\Barnett (SQL Server)\\SMT_Barnett\\SMT_Barnett.tks

Merging text Files Many to One with one header

I have some text files, same schema, to merge into one text. How can I accomplish this without connecting each file one by one to the single output text file and keeping only the header from the first one? e.g. header_1 header_2 header_3 header_4 text_1 text_1 text_1 header_1 header_2 header_3 header_4 text_2 text_2 text_2 I want to exclude the headers from 2,3,4...files, so that i get: header_1 header_2 header_3 header_4 text_1 text_1 text_1 text_2 text_2 text_2 Thanks.

OBJ to Cesium Problems

Hi. I'm trying to convert a mesh model from OBJ to Cesium, there are some problems occurred. 1. The SRS of OBJ is EPSG 2326, but FME shows error when reprojecting model to EPSG 4978 for Cesium model. I tried enable and disable Reprojector, but it still return error "could not create reprojection engine". 2. So I re-create the OBJ mesh in SRS 4978 for conversion. Then I added the result (in Cesium) to web page, my model cannot be shown. Did anyone successfully convert OBJ to Cesium using FME? Where can I find some resources or sample workbench file of this conversion?

OBJ to Cesium Texture Problem

Hi, I found some problems after the conversion from OBJ to Cesium using FME. The original OBJ model like this: But after the conversion, the model in Cesium like this: The geometry is checked and it is matched to original. But the color tone of texture seems to be edited. How can I solve this problem?

HiI am trying to convert a DWG file (AutoCAD 2010) format into AutoDesk DWF file format. The DWG file is an architectural drawing file and include various blocks, hatches, mtext and even XREF. When I convert DWG to DWF from AuoCAD environment the output is very clear without any loss of objects as shown belowBut when I convert DWG to DWF using FME Desktop 2015.1.3.0 the output is not at clear, looks distorted and has missing objects as shown below. I tried various settings but still no success. Please let me know if you have any ideas or solutions

Error occurer in function AutoCAD2004writer:WriteInsertAttribute, exception thrown: 'invalid input'

Hi, I´m trying to convert data from a ArcGIS filegeodb to AutoCAD DWG. In the proces I´m getting the following error which says absolutly nothing to me. Does anybody have an idea on where the problem could be?AutoCAD Writer: An error occurred for dataset 'C:\\Temp\\RF2017\\RFgrundkort2017.dwg', in function AutoCAD2004Writer::writeInsertAttribute. Exception thrown: 'Invalid input' (Invalid input)Thanks Christian

Google Maps KML to TAB not showing user attributes in separate columns

I have an editable KML with all its user attributes showing in a data table in Google Maps - showing as above when I click on the map objects. I want to be able to export that data back out of Google Maps to TAB or Excel (or anything!), with all these user attribute fields. However, when I export this from Google Maps and look at the Feature Types of the KML Reader in FME Inspector, there are no User Attributes, only Format Attributes. When I use the Inspector, the attributes look as below - there are no kml_schema_ attributes, only kml_data attributes with name (attribute column heading) and value, each one suffixed 1, 2, 3 etc. So when I use a simple workflow with no transformers to export this to TAB, all user attributes are concatenated into the kml_description field as shown below. I have a feeling this isn't normal...……. My original export to KML for Google Maps was from a Shapefile using QGIS export tool (I removed text from "DescriptionField"), and the data

How to load text data lines into an attribute?

I have a bunch of text files and each files contain one feature different attributes. I want to load the first line data as the first attribute, the second as the second attribute. Could you please give me ahint how to implement it? Here is the process, that I am using:

1362

5 years ago

dberger106Participant

asked in Data

ProjectWise Connector

Has anyone had success using the ProjectWise connector in FME 2018.0.0.2 (64bit)? If so would you be able to share your set up or configuration - or if there were any "gotchas" that you came across.We are using ProjectWise which allows me to access it through a browser via https://projectwiseweb.lendlease.comThis succesfully brings up a page whereby you can select a "Location" (of which we have multiple) and type in credentials. Once you are in you can navigate similar to the ProjectWise explorer desktop app. If I use that URL and credentials in the ProjectWise Connector I get "Failed to Load folder from Bentley ProjectWise"Would love to hear from anyone who has had success with this connector as it will really open up some great opportunities for us. Could someone from Safe also have a look into the help documentation for this - there doesn't appear to be any. Thanks!

Set datatypes for generic attributes in CityGML

Hey,I'm converting data from IFC to CityGML. I used the GeomertyPropertyExtractor to extract attributes from the IFC PropertySets. These attributes all have the datatype string. These attributes are set as generic attributes in CityGML, but I want to change their datatype. I can do this for integers, doubles,... in the CityGML-Writer. But I also want to set data types like meter and square-meter. CityGML supports the data types like meter with the data type MeasureType.Does anyone know how to set these data types?Thanks

270

5 years ago

philippebEnthusiast

asked in Data

Excel Start Column Value Option

Hey FME 2019! What's up!? Do you know how I can calculate a value and pass it through the Start Column / Row Excel Writer parameters? I don't see the way to do it! There is no Attribute value option. Thanks!

100

5 years ago

ladeefContributor

asked in Data

Clip DXF from polygons and create new DXF

Hello, I'm trying to clip a dxf file with a shapefile into sections and export back into separate dxf files. I'm using the clipper but I'm unsure whether to merge individual feature types on import and how to retain all the layers on export.

Which FME Python option to use?

I have an ArcPy script that is simply renaming ~40 datasets in an ArcSDE database. I'd like to run it once by Master FME workspace is complete (set of workspace runners ), so i had thought of using the Shutdown Phyton Script in workspace parameters. However i am very new to FME and to Python to be honest, so it's all a bit confusing (even after reading the information relation to the Python transformers etc).Can i simply copy and paste my script into the blank window of the script parameter? i.e. import arc py, list variables, include updates to be made etc? or is there a way of including the file path to the python script that sits on my c:drive and have FME activate it? Thank you in advance

5 years ago

bino

asked in Data

Calculate Attributes from Shape file

Dear All ,I have a roofs & footprint of each building, from this how i will create all the below mentioned attributes in Shape file (.shp).Please help and suggest.1,Unique Feature ID2,Reference Name – China3,Building Area (m)4,Building height Values (m): Max, Min, Mean, 75th and 25th percentile5,Building Height will be orthometric (Mean Sea Level) and Above Ground Elevation (AGL)6,Building attributes will be MSL_Ground, MSL_Min, MSL_Per25, MSL_Mean, MSL_Per75, MSL_Max, AGL_Min, AGL_Per25, AGL_Mean, AGL_Per75, AGL_Max, Shape_Length and Shape_Area

5 years ago

dcn23

asked in Data

Issue viewing data in ArcPro/ArcMap written with FME

Hi all,I am having issues viewing spatial data outputs in ArcPro or ArcMap. FME successfully writes all features to either feature class or shapefile (tried both) but when I open the data in Esri many of the features are not displayed. This doesn't happen all the time, but its been an issue with multiple workbenches all doing different things. When I add the result layer to Map/Pro the correct number of features show in the attribute table but the 'problem features' have the following issuesFill symbology not applied, only outline symbology (i.e. Problem features not selectable with "Select By Attributes" toolProblem feature only selectable using select tool if the selection box cross feature outline The image below shows layer results right after adding to ArcPro. Copying the feature class either by catalog or copy features tool does not resolve issue, but running a tool like buffer with 1cm seems to fix it. Any ideas? Much appreciated!

560

5 years ago

jacklonsdaleContributor

asked in Data

15,000 GML Merge

Hi all, I have over 15,000 GML files, totaling 43 GB, containing grids for OS Mastermap, and I want to stitch them together into one Esri Geodatabase.I tried a single merged feature type reader to a single writer, but it became painfully slow and only wrote a fraction of the files. Has anyone any advice or know any limitations to try and attempt this? Thanks in advance!Jack

ArcGIS Online Feature Service Reader: Encountered an unexpected error. The error code from the server was '400' and the message was: 'Cannot perform query. Invalid query parameters.'

I'm following this write-up on how to update AGOL hosted feature layer from file geodatabase feature class. I spent hours on a chat with FME tech support troubleshooting but no luck so far. This is my first experience with FME so I'm not sure what is going on as I followed directions precisely.The AGOL reader gets stuck after processing 24,000 parcels (30,162 total) and throws the error. I'm demo the software so its the latest version.

FME 2017 deployed in Active Directory 2016

Our company is currently upgrading our Active Directory to MS AD 2016. We are reaching out to our vendors to ensure applications won't be impacted by the move to the latest Active Directory. We currently use FME server build 17539 and would like to know if this build will work with AD 2106. Appreciate the info.

5 years ago

Page 108 / 273

Badge winners

logan.petershas earned the badge FME Form Basic Training
safe101has earned the badge FME Form Advanced Training
victoriageohas earned the badge Student (Grey)
tb0505has earned the badge Welcome Back
thomasshas earned the badge English Speaker

Show all badges

30,417: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.