- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,779 Posts
24,923 Replies

When you subscribe we will email you when there is a new topic in this category

6779 Posts

Recently active

Most replies Most views Newest first

nathContributor

asked in Data

draw lines between points

HiI have to draw lines between two points with different attributes. They have a common number but in another field.All point have to be connected with a line to the networkI have already made a table with the coordinates of the beginpoint and the endpoint in the same record.As the endresult i have to become lines with a unique Id and the attributes of the point where the ID starts with HP_.Can sombody help me please?Thx!Nathalie

pratapContributor

Hi,I have a dgn file with dimensions for which value of each dimension is edited i.e. If we measure between the dimension lines then it is 105.456 but the dimension value has shown as 500.When I have seen in inspector it shows 105.456 but not 500. Do any one knows in which attribute does the value (500) store???

8 years ago

david_allan

asked in Data

How use the legacy SDE writer with versioning and archive tables

Is there a parameter that needs to be set or a specific trick to getting the legacy ESRI sde writer to update archive tables when inserting records?The current setup is as followsA direct connection to an ArcGIS v10 geodatabase in an oracle 11g database, writing directly to the DEFAULT database version. The schema for the feature class is derived from a workspace resource pointing at the same sde database with the same connection detailsThis correctly updates the Adds tables for the versioned feature clases but no records are inserted into the archive tables. Is this just a product limitation, a bug or am I missing something?I can get the archive tables to update correctly when using the ESRI Geodatabase writer, but want to avoid this due to the ArcGIS license requirements and the performance benefits of the legacy writer.

8 years ago

danpaolyContributor

asked in Data

ArcGIS Portal

Does anyone know if it is possible to load ArcGIS Server feature services to ArcGIS Portal or will FME only work with the free outward facing ArcGIS Online. Thanks

8 years ago

keithoContributor

asked in Data

Custom linestyles containing point graphics not displaying when writing to DGN v8

Using FME 2016 writing to DGN (v8)Having trouble with custom linestyles that contain point graphics displaying within my DGN file after translation. I cannot draw or even change an existing line to one of those styles. These linestyles exist in the seed that I have attached to the DGN Writer and I can draw them within the seed. Note all other non point linestyles within the seed display correctly in the translated DGN. Any ideas?

8 years ago

jdhContributor

asked in Data

Json extractor nested arrays

I have a json object that contains nested arrays, a simplified example is:{ "Attr1" : [{ "Attr2" : [{ "Attr3" : "A" } ] }, { "Attr2" : [{ "Attr3" : "B" }, { "Attr3" : "C" } ] }, { "Attr2" : [{ "Attr3" : "D" }, { "Attr3" : "E" }, { "Attr3" : "F" } ] } ]}I would like to extract just attr3, either as a (complex) list, or a valid json ex. [{"Attr3":"A"},{"Attr3":"B"},{"Attr3":"C"},{"Attr3":"D"},{"Attr3":"E"},{"Attr3":"F"}] If I use the JSONExtractor with json["Attr1"][*]["Attr2"][*]I get {"Attr3":"A"}{"Attr3":"B"}{"Attr3":"C"}{"Attr3":"D"}{"Attr3":"E"}{"Attr3":"F"}'without commas between elments. The JSONFlattener with recursion does work, but the actual json has a couple of hundred additional elements, and I would like to avoid creating them unnecessarily if possible.

Writing nulls into numeric field from csv

Reading a csv file with null entriesID, A, B, C, DQA123, 1,2,3,4QA456,,,,Into a table with character_varying, numeric, numeric, numeric, numericWriter fails on line QA456 with errorError was 'ERROR: invalid input syntax for type numeric: ""CONTEXT: COPY table, line 2, column A: ""How can I deal with this issue?ThanksUsing FME Desktop 2015.1

527

8 years ago

pratapContributor

asked in Data

Graphic groups to Graphic cell in DGN

Hi,I have dgn files will features having unique number for each graphic group. I want them to convert them to graphic cells (CTRL+G in Microstation)Is it possible with FME?Pratap

8 years ago

geobaehr

asked in Data

Updated workflow using FME to condition polygons to CSV for Tableau?

Basically converting an ESRI polygon Shapefile or FeatureClass from spatial to non-spatial in a format ready for Tableau (i.e tabular like excel or CSV). Have researched and tested some possibilities but would think there are some quick start workspaces available from Tableau and FME users.Have some ideas that successfully converted polygon vertices to points (helpful VertexCounter)Other transformers helpful are DonutHoldExtractor, 2DForcer, Counter, Generalizer?, CoordinateExtractor - just hoping something already exists.

8 years ago

asked in Data

Creating PDF file from a .mdb access database

8 years ago

j_geo

asked in Data

Polygons (trapezoids) from lines

I want to make polygon (trapezoid) from each line segment that has information about trapezoid width at start and at the end.Is it possible with FME?

1112

8 years ago

asked in Data

Is it possible to convert Access .mdb to .xml format

Use UserParameter for Writing OutputFile

I want to use a UserParameter to define the OutPutFile, here a FileGeoDatebase.The Path and Filename generated generically in the Workbench.To make the Attribut to a Parameter is using a AttributCreator.The ParameterType ist testing with Text, Folder (Output), Filename (Output).No success

Missing Features in Output

I'm new to FME.I've created a workspace that reads one Microstation V8 (dgn) file, and several shapefiles. It reads all features from the .dgn as well as all features from the shapefiles and outputs them into two new .dgn files. The first output file contains all features read, while the second one only contains the features from the shapefiles and not the features from the .dgn.Now, I actually need this to run on a whole bunch of datasets, so I exposed all of the input files as parameters and run it from a batch file. The default value of all the parameters is the files for the test dataset I was using. When I run the the workspace on the test dataset either in FME Workbench, or on the command line, everything works perfectly. When I run it on any other dataset, none of the features from the shapefiles is written to the output .dgn files. FME reports warnings, but the translation is always successful.I've attached the workspace file, as well as logs from a successful

pratapContributor

Hi,I have used a dgn file with "Expand Names cells" as "Yes". I want to make cells again as it is before...Is it not possible to make the cell again without cel library?BTW, I have used aggregator with igds_type=igds_cell but it output is coming as same lines.Pratap

Joining multiple worksheets in Excel to another database in order

I have an excel spreadsheet with years of maintenance data (2006-2015). I need to join that to our current pavement database, but in order. So if something was done to a road in 2007, and again in 2014, I need it to join the 2014 data (over write the 2007 data). Not sure if this matters, but not everything will match from the spreadsheet to the existing database (many fewer records in the excel sheet as we do not do something to every road every year). I've tried joiner, but no luck. In the parameters you can select all of the spreadsheets to read, but in the join section, you can only pick one year? Doesn't make sense to me.

8 years ago

ben

asked in Data

GUI DYNAMIC_MULTI_SELECT_COMMAS and undefined macro

Hi,in my reader, I use the GUI TYPE "DYNAMIC_MULTI_SELECT_COMMAS" [1] so a user can selects/types some values. The sections in my metafile are:DEFAULT_MACRO HOST localhostDEFAULT_MACRO PORT 8080! ...some more codeDEFAULT_VALUE HOST $(HOST)GUI STRING HOST Host:DEFAULT_VALUE PORT $(PORT)GUI RANGE_SLIDER PORT 0%65535%0%OFF Port:DEFAULT_VALUE LAYERLIST $(LAYERLIST)GUI OPTIONAL DYNAMIC_MULTI_SELECT_COMMAS LAYERLIST HOST,$[HOST],PORT,$[PORT] Layer Names:This works fine, but whenever I start a translation, I get the error:Undefined macro `HOST_MYREADER_1' dereferenced in file `C:\Users\User\AppData\Local\Temp\wb-xlate-1456160185578_8088'Program TerminatingTranslation FAILED.caused by $[HOST] in the DYNAMIC_MULTI_SELECT_COMMAS line. I can fix this by generating a Published Parameter called HOST_MYREADER_1 in my workspace, but I would like to understand the error. What is the problem here? I have created a macro called Host (and Port), why does FME crashes here?Another solution is DEFAULT_VAL

8 years ago

adam

asked in Data

Is there a GoogleReverseGeocoder?

I have been successfully using the GoogleGeocoder transformer (https://store.safe.com/transformers/googlegeocoder... to obtain coordinates based on addresses and intersection input for some time. (Thanks for that, by the way!) However, I am now being asked to generate intersection and address information based on X/Y's. Is there such an animal out there that already exists? Any thoughts on amount of effort to modify the GoogleGeocoder to provide that functionality?Thanks,Adam

8 years ago

philippebEnthusiast

asked in Data

esriFieldTypeGlobalID missing in field type

Hello!When I create a ArcGIS Online writer and want to add a GlobalID as an attribute, the type to choose is esriFieldTypeGlobalID but FME doesn't offer me this choice.In the log I can see this message : "ArcGIS Online Feature Service Writer: Attribute 'GlobalID' on feature type 'Frenes' has type 'esriFieldTypeOID', but the type on the server is 'esriFieldTypeGlobalID'"I think FME should add this field type.Thanks!

Vendor sent lots of data ~11.2 GB of ECW files (8 files),I have a shape file for clipping the ECW, and I have been unsuccessful, i have done lots of research to determine if this is even possible, as clipping an ECW will always still have the "Black" and white areas that are part of the image seen below,I have converted to other formats (png, jp2, geotiff) and attempted to clip in FME and ESRi, but still no progress (esri crashes, and FME wont clip areas I need clipped),My fme process consists of and this file is pretty standard for basic clips, unfortunately I can't provide the ECW file due to restrictions, but any suggestions would be helpful, as I have searched for all the previous ones,Thanks,Doug

Is it possible to read the cell fill colour when reading data from an Excel spreadsheet

I have a spreadsheet which I need to load into Oracle on a regular basis. The user has colour coded some cells and I need to import this fill colour as well as the cells textI don't see any way to do this but hope to be proven wrong

Failed to open writer "SQL server DB"

I publish a service on FME server and when I run workspace as job using admin user it works good but when I call web service using guest user, it gives me the following error

185

8 years ago

koenContributor

asked in Data

For a client we are working on a large fme workbench which has to insert data in multiple oracle tables which are related with several foreign keys.In earlier versions we got a lot of 'parent key not found' errors while running, so we put writing of parent tables in separate writers so they would be executed first, and that would solve that problem.The problem now is that the system also has Oracle Rule Framework to guard several business rules on the database. Rule Framework will test these rules on every commit to check if all rules are met, if not it will rollback everything.This leaves us with a problem since our separate writers will each commit when finished and than our rules are not all met and everything will be rollbacked. So to comply with the rules all feature types should be written by only one writer and be committed only ones. But than we have the first problem with our foreign keys again.Removing the foreign keys, even temporary, is not an option for our custome

FME, Microsoft Access and Workgroup files?

In the FME 2013SP1 documentation on the Microsoft Access Reader/Writer, there is language that states:Please note that databases associated with a Microsoft Access workgroup are not supported.http://docs.safe.com/fme/2013sp1/pdf/reader_writer_pdf/mdb_ado.pdf, page 3I want to assume that this is still unsupported functionality in FME 2014+. We're trying to use a database with a workgroup file, and we can't get into the provider to change the user name.Is this still unsupported? Has anyone here ever successfully connected to an MDB with a workgroup file in FME 2014+?

8 years ago

aquamarine

asked in Data

Exporting to tags in Microstation v8

Hi,I have successfully exported tags to a Microstation V8 DGN file using FME 2015 Desktop software.However when I open the DGN file in Microstation and turn the tag display on using the "Edit Tags" tool, the tags are displaying about 300km away from the actual data.Can anyone explain why this is happening? Could it be a setting in the DGNWriter or something to do with the Seed file?Thanks,

183

8 years ago

Page 224 / 272

Badge winners

iangrhas earned the badge Student (Grey)
sameerbajracharhas earned the badge Teacher (Grey)
sameerbajracharhas earned the badge Conversationalist
fmetutorialhas earned the badge Teacher (Grey)
disco2000has earned the badge Student (Grey)

Show all badges

30,108: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.