- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,820 Posts
25,119 Replies

When you subscribe we will email you when there is a new topic in this category

6820 Posts

I am new to FME. Although I can deduce how to use @value(Attribute) in a text editor in the workspace, I am not sure how the $ symbol is used and how it can be chained to say @value. Also are there other keywords with the @ symbol. Where in the documentation are all these symbols and their usage comprehensively defined and illustrated? Thanks.

425

6 years ago

fmelizardContributor

asked in Data

I can't start the FME Server core on linux

It seems like core isn’t starting because the web interface is complaining about not being able to connect to core and running `sudo ./startServer.sh` results in this error: ```Cannot open log file /opt/fmeserver/resources/logs/core/current/fmeprocessmonitorcore.log for writing, defaulting to standard error output```

6 years ago

david_prosack88

asked in Data

AVF Writer and Reader attribute differences

Hi Everyone,I am writing to the AVF writer and then using the AVF reader in separate workbench. However, I noticed that there are two different naming conventions for Level _Ids under Sections category. See attached pictures. Is there a reason why they are different? I know that in the AVF Writer, it is a list, but the AVF Reader does not show it as a list. When I run the AVF reader in my workbench, level_id does not exist. I am using FME 2018. Thanks!David

6 years ago

pratapContributor

asked in Data

DRW to DWG/DXF

Hi Guys,Did any one tried converting DRW files to DWG/DXF?Pratap

How to check if all parts of a shape file were uploaded to FME server?

If we use a shape file reader in FME desktop we only need to pick the shp-file but not the other parts like dbf, shx etc. FME desktop recognizes all parts of the shape file and we can start our workflow.If we publish the same workspace to the server and use a published parameter for the shape file then we need to upload all parts of the shape file as a temporary data upload to FME server. If one of the parts is missing then our workflow will not run. How can we check (in advance?) if all necessary parts of a shape file were temporary uploaded to FME server?Best regards,Frank

Export linkage data from DGN

Hello,I have a DGN file (Microstation v8) which stores spatial data elements (elements with XY coordinates). The elements are linked to an external database. I need to export the data from DGN file and join the exported data with its associated data in external database. I am using FME workbench with reader format as "Bentley MicroStation Design (V8)" and writer format as GeoJSON.When I redirect my output to FME data inspector, I see the linkage data in a field called "igds_linkage{0}.blob (encoded: fme-binary)". Sample value for this field is E06E00000000000000000000. The actual link value in the external database for this element is 28384 which is 6EE0 in Hex. I can get the same value by swapping the first two bytes of igds_linkage data i.e. from E06E to 6EE0.Now, my issue is that this data is visible in data inspector only. How do I export it into my output GeoJSON file?The field "igds_linkage{0}.blob" is a Format attribute of type char(255). I've c

Does FME support Inserts into Hive tables using JDBC

6 years ago

jkr_wrk

asked in Data

Autocad dynamic block name extraction

In this drawing there is a block named:'Verkeerssignalering Mantelbuis (Lusconfiguratie)'How do I get this exposed in my FME Workbench? I have tried exploding, not exploding, merging exploded to not exploded etc.

How to flatten a multi-record tab table into a single record Excel table...and some stats?

Hi all.I've got a tab file that I run a few queries against it to pull out some values which based on a published parameter used for the query. The results are then written into an Excel tableIn this case the publish parameter ‘LEASE NAME’ used in the query has extracted the Collingwood 3 data from dataset. Seven records were extracted however I’d like to make those into a single record that contains data from each attribute where present. Additional I want to sum the values in the length columns.At the moment it looks like this.But I want it to look like this.What should I be doing to get this result? Thanks a heapMichael

700

6 years ago

jhawksContributor

asked in Data

KMLviewssetter: advanced kmlviewsetter balloon formatting.

I'm starting with background color as a test, since it takes html I thought this would change the balloon BG color but it's not working. <html> <body bgcolor="#E6E6FA"> <img src="https://seamlessrnc.nauticalcharts.noaa.gov/rnc/noaa_ocs_small_banner.jpg"></a> <BalloonBGColor = '-1' BalloonFGColor = '-16777216' BalloonBGColorField = ''red" > </body> </html>

6 years ago

gislogan01

asked in Data

How can I Convert an esri feature class to a KML and assign colors based on the attributes in the feature class

How can I Convert an esri feature class to a KML and assign colors based on the attributes in the feature class I have some line feature classes (roads) which have a condition rating and a color based on that rating. i would like to convert these feature classes to KML and assign them colors based on the condition rating.

6 years ago

chris_mParticipant

asked in Data

Can't access Pervasive database

I get the following error when trying to access a Pervasive SQL databaseStarting translation... FME 2018.0.0.0 (20180308 - Build 18284 - WIN32) FME Database Edition (node locked-crc) Temporary License: 16 days left. Machine host name is: cmcclain Operating System: Microsoft Windows 10 64-bit (Build 16299) Copyright (c) 1994 - 2018, Safe Software Inc. Safe Software Inc.Creating reader for format: Pervasive PSQLTrying to find a DYNAMIC plugin for reader named `PERVASIVE'Loaded module 'PERVASIVE' from file 'C:\\apps\\FME\\plugins/FME_ADO.dll'FME API version of module 'PERVASIVE' matches current internal version (3.8 20180209)Pervasive Reader: Read 0 DEF line(s). Found 0 attribute(s)Pervasive Reader: Opening `mcsdb' for read operationPervasive Reader: Connection failed. Connection string `Provider=MSDASQL;DSN=mcsdb'.

Failed SQL Server Database Connection

I am trying to create a database connection to a SQL Server Express instance on an in network server, but I'm not having much luck. I have made sure the TCP/IP is enabled, the TCP Port is set to 1434, TCP Dynamic Port is empty (I have tried multiple options there as well). The SQL Server Browser service is running. I have restarted the SQL Server service. I am able to ping the server. Does anyone have any other suggestions to try. This is the error I receive. Thank you!

Some Excel writer worksheet/ranges not getting populated after upgrade to FME2017x64

I am migrating from FME 2014 to FME2017x64. We have been using a workbench for some time in which the output includes writing to a number of excel template worksheets having defined ranges for the writer. In each case the option to truncate the range has been set to yes. When running the same workbench in 2017x64 I am now seeing that some worksheets/ranges are getting populated while the vast majority are not . I've been looking for something that indicates why some would get populated while others would not but have not been able to determine what that might be. Has anyone else experienced problems with excel writer in FME 2017 not writing to worksheet/ranges as they had in a previous version?

Center Point Extractor

Hi All,I am trying to get the center point of a room without replacing the geometry, i.e using the center point replacer. When I use the Center Point Extractor to get the center point lat and long, the lat and long ends up in South America. I'm confused because the Revit file displays in Texas, which is correct. Can anyone help explain this?I am using the IFC reader to run the Revit file. The RefLat and Long are in Texas. Can this be caused by the Revit file Min and Max Reference coordinates? I'm thinking the vertices in the Revit file are not correct. I do not know Revit unfortunately, I only receive these files. If there something wrong with the file, or something that the Revit Technicians should fix, that would be great to know and understand. Any insight would be great!Thanks,David

AutoCAD DXF files created by FME are larger than those produced by other software packages. How we can reduce that. I have many dwg files to convert to DXF. Thank you

110

6 years ago

robertoContributor

asked in Data

SSO cross domain users

Hi all,I’ve a question regarding single sign on into FME Server.I’ve installed FME Server on a domain (let’s call it “Domain A”) and I’ve configured the SSO for the users in the Domain A. I’ve tried to log in on a client using right domain A account and then, using Internet Explorer, I’ve logged into FME Server in SSO mode and It works fine.Now I have another domain (let’s call it “Domain B”) trusted with Domain A in bidirectional mode.In FME Server I added the connection to the Domain B’s Active Directory and imported the users from this domain.I tried to log in on a client using right Domain B account and then, using Internet Explorer, I logged into FME Server in SSO mode but it not works.The returned message is “You are not authorized to access this web application”Can someone tell me if I need to set principal name, using the setspn command, also in the Domain B?Thanks in advanceRoberto

Can the tool migrate data from Documentum to SharePoint with metadata?

We have a migration project kicking off and the team here is already using fme for Documentum. I want to know if the tool has the capability to perform a migration from Documentum to SharePoint Online whilst maintaining metadata and structure from the source.

Writing in an Autocad extended data

Hi ! I have a problem with Autocad extended data. I added a "data property set" in my ACAD file with an attribute named "UAID". I found it in my extended data properties on Autocad.I would like to find it when in FME in order to write in the "UAID" field a unique number that is read from an Excel. I don't know where can I find the UAID, can anyone help me ?

Geodatabase error 2147467259 Could not read Field

Guys,something wrong is going on. I was changing existing working workspace to pointing to new geodatabase zip file, which also has new table structure. Modified new workspace is working fine on my PC under FME Workbench. But if I publish it on FME Server I'm getting the error (see below) for each attribute that we are not reading from geo tables. And since original database is huge after few minutes FME Server stops the job without any failure message and building core dump files on FME Server machine.Error messages that we are getting:Geodatabase Error (-2147467259): General function failure. Could not read Field `column_name' in Table `Table_name'Does somebody know where the issue can be?Appreciate any help!Thanks.

DonutBuilder: Two Polygons on different heights, incorrect donut – random heights assignment

I am writing a CityGML file by reading the LOD2 3D building models from the DGN file.While reading the DGN, grouped holes are exploded, i.e. “Expand Unnamed (Group Hole) Cells: Yes” and then DonutBuilder is used to re-build the required geometry, i.e. grouped holes. However, rebuilding the grouped holes with the DonutBuilder for the polygons at different heights does not work properly and seems to randomly assign the Z from either the top or bottom or some from bottom and some from top. Please see screen grabs below showing building superstructures:The part that re-builds polygon cutouts is as follows: I used the Group By: “igds_cell_name_sequence_number” from the original DGN grouped hole cells that got expanded when read in order to rebuild them again with DonutBuilder. I tried different Z Modes but it did not help to prevent from incorrect group hole building It seems to be random, in some cases it will built a correct geometry, in other, it will do the incorrect “unexpected” geomet

6 years ago

mickael

asked in Data

How does FME attributes work with OSM tags ?

Hello,I am trying to work with data from OpenStreetMap, and I have an issue with retrieving tags. The only tags I get are the ones related to 1st level types. Other attributes appear in the inspector right panel, but I cannot access it from in my workflow. So what is the difference between attributes from the Table View and the Feature Information ? Is there any way to access those specific features information from the Workbench ? Strangely enough, when I check the "Determine feature by scanning the entire dataset", all tags also appears in the Inspector Table View (with a lot of missing values). But I cannot use that option from my main workflow, as my dataset is an URL (returning an OSM XML file). So far, I am only looking for a few attibutes on a few elements, like the "layer" value for highways (which indicates if they are underground and above or below other highways). Any help would be much appreciated, as this is very important for my work :)

PDF transformation problems

I'm struggling to transform some pdfs. I am using the PDFtoTEXT transformer as well as a textwriter, stringsearcher, maybe calling to python, and then writing it to a database. I'm flummoxed at the first step.Sometimes it'll write a pdf to a textfile. But often the pdf2text program box pops up. That's useless for automation. What I want is for it to read a whole folder of texts - found the place to specify that - and process each of them into a complex row in my database with many different values. The pdf contains a couple values in the headers and many more in a table-like layout. I will need a couple string parsing processes to get through all that. No idea how to get it to read the pdf name and put that in one cell in my db.But the data inspectors are useless. The interface says the transformation was successful - but nothing was written to the output.txt.So - issues:- how to process multiple texts- how to see what's going on so I know it's working properly

How do I create a working .dwg file from a paper copy of a drawing that I scanned and saved as a PDF?

6 years ago

michuup

asked in Data

Convert osm pbf to shapefiles

hi, what I do wrong when convert osm pbf to shp? i try to create a simple workspace but i got nothing = and i try manual add reader and writer, and i have errors = can anyone help me?

1260

6 years ago

Page 165 / 273

Badge winners

james_c_452has earned the badge Webinar Watcher (Bronze)
vidhyarhas earned the badge Integrate Spatial Data
boostpadhas earned the badge FME Flow Authoring Training
sam_keasthas earned the badge English Speaker
sam_keasthas earned the badge Integrate Data with the FME Platform Training

Show all badges

30,425: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.