- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,818 Posts
25,115 Replies

When you subscribe we will email you when there is a new topic in this category

6818 Posts

Using the FeatureWriter

I'm using a FeatureWriter to create an Access Database and for the most part I'm very satisfied with the results.However there are some quirks that I don't understand.First, I didn't find anyway to update the created database each time I run the FME. I have to first delete the previous table to be able to generate a new one.Is there a way to automatically update the table with each run of FME?Secondly, in one instance, while FME shows 8 206 610 rows have been generated, only ~4000 have effectively been written in the Access database. I added an inspector before the FeatureWriter, and the inspector shows 8 206 610 rows.Any idea on what happenned? what did I missed?

Overwrite option in Google Drive Connector “in download option”

Hi all, I’m using Google Drive Connector to download a folder contains images to process them later and convert them to points feature class. When I rerun my workbench I got an error from google drive connector said that the destination exists and when I delete this folder my workbench works fine.Is there anyway that I could setup my Google Drive connector to overwrite the existing folder or anyway to delete that folder through the workbench it self before the google drive start download it again? Thanks,Rawan

Select Single Attribute Value from Multiple Feature Classes

Hi Everyone, I hope that someone might be able to provide some guidance or suggestions on a task I am attempting with FME. My team is in the process of cleaning up our GIS data, and as part of this clean-up effort I have been asked to determine all of the records (from various attribute fields) that contain 9999 across all feature classes. So for example, Feature class A may have attributes in the 'Material' field with a value of 9999, Feature class B may have Diameter with 9999, Feature class C could have Install Year and Material with 9999, etc.. Is there a simple way to perform this task to search for all 9999 values across all feature classes? I would appreciate any assistance that could be provided! Thank you,Shelley

501

5 years ago

moberdriesContributor

asked in Data

FME Server Automations and Multi-Engine Task Completion

I have an FME Server Automation, triggered as a schedule, that has these basic steps: Reads binary files from a SFTPS site and writes to staging folder (A)Reads binary files from staging folder (A), decode files, and writes out to staging folder (B)Reads decoded files from the staging folder (B) and writes to a Vertica databaseCleans up on staging folders (A) and (B), ready for next schedule The decoding bit in step (2) takes its file input from a PATH Reader and can take some time to finish, so I run the workspace in parallel against a FME Server queue across 4 engines. My issue is that the Automation moves to step (3) as soon as 1 of the 4 engines becomes available. Step (3) and step (4) are fast and complete before the remaining 3 engines running step (2) complete. This results is 3 files arriving in the staging folder (B) after the Automation has finished. QUESTION: Is there a ”simple” way to make the Automation wait until step (2) has fully completed on all 4 engines, before m

510

5 years ago

danamosParticipant

asked in Data

Text File Encoding Problem

Hi,I have a problem encoding a text file to the correct format. The below images show:1) the *.prj document properties of an outputted Terrascan Project from a Matlab programme:2) the *.prj document properties of an outputted Terrascan Project from an FME Workbench.Only the file at 1 can be loaded directly in to Terrascan.If the file at 2 is "Saved as" in Textpad, the option to change the line ending to "PC" is available as shown below.In doing so, the file will then load in correctly into Terrascan. Please advise where I maybe going wrong.The template workbench as a small selection of the files is below:Any assistance the can be offered would be much appreciated!

When writing data from filegoedatabase to postgres some features come geometry field empty or not complete. However this data in fme it shown geographically correct .

the problem when i see data in pgadmin i cant perview data correct . however it is shown in fme inspector fme2019.1

How to read multiple csv with dynamic URL ?

Hello I have a problem,I try to read multiple csv from an URL that changes.An exemple of URL : https://archive.luftdaten.info/2019-11-11/2019-11-11_sds011_sensor_26828.csvhttps://archive.luftdaten.info/2019-11-11/2019-11-11_sds011_sensor_26760.csvI tried to use an HTTPCaller and it works but I don't know how to treat the result. I don't find any transformer that can help me to translate this string "csv" into a list of attribute. If someone can help me it could be great please. Here are two images of what I get with httpcaller :

Hello, have a excel sheet with more then 20.000 records and only two columns. I want to divide the two columns into 7 columns: The problem now sits in the PART_COLOR, not every row has a color, see my result: Is there anyone who can help me with this "little" problem? I will explain what my workflow now is:StringSearcher: I search for the string "SET NR001" in the Description column. So I only get this value's instead of all the other ones. (about 90 different parts).AttributeSplitter: split the Description column on every "space" and put them in lists.AttributeManager: create outputs for every list.AttributeCreator: create the different outputs for the different inputs, for the "Name" output I use list5 + list6. Perhaps I am using the wrong tools, but I am a starting user at FME.

cad hatch geometry missing

HiI want to convert polygon shp to cad hatch,everything is fine ,except the hatch geometry attribute only have elevation ,the area is missing(we badly need it in production environment). I do some test, find out that may be the area attribute is assosiate with hatch boundary. is there a way I can do to get area attribute wirte in cad hatch in FME workbench?Thanks in advance

Error writing to an SDE with relationship classes.

Here is the error that I get when the translation fails: "Unexpected execution path. Please contact Safe Software GeodatabaseRelationshipFeaturesPipeline::GeodatabaseRelationshipFeatures(SortFactory): A fatal error has occurred. Check the logfile above for details. Some error has occurred closing the pipeline factory, see previous warning None of the edits made during the edit session were saved."I'm using the Data Interoperability Extension through ESRI (ArcGIS 10.4.1). I am new to spatial ETL processes, but I followed the FME tutorial on Writing to Relationship Classes so I believe that the workflow is set-up properly. I haven't found much doc on this issue, so I'm reaching out to the experts for help on this.Thanks!!

Hello,I'm trying to create the worspace that I need to publish and automate later in FME Server.There are 2 SDE Datasets, lets say the Set "A" and "B".I have to delete some feature types (that contains also Relationships, Tables etc.) from Set A (also Domains!) and write new (actuel) feature types from set "B" into the Set "A" (of course with the domains). Do you have an idea / model of the workspace? At the beginning I do not try to test this with a .SDE-Reader, but with .GDB.Thanks for all tipps!

Receiving SMTP on FME Server

I am trying to find out how to route email to FME Server so Publications can pick it up and process accordingly. The problem is that I cannot find anything in any tutorial or piece of documentation. Here's a scenario:We use Office 365 and use email in the form <first.lastname@company.com>I would like to set up a subdomain so email sent to @fme.company.com is routed to the fme server at fme.company.comMy understanding is that an MX record needs to be set up on the firewall. The primary email server receives all email addressed to @company.com. It would then need to know what to do with email addressed to a subdomain, so if an MX record exists, it knows to forward/route to a different SMTP server. If the subdomain is unknown, it would bounce back with an error message to the sender. Hope I'm getting this right and it makes sense.However I'm not sure what else needs to be set up in order to route SMTP traffic to FME Server. Any help would be greatly appreciated, especial

270

5 years ago

takashiContributor

asked in Data

Reading Order of Multiple Excel Sheets

Hello, I have an Excel dataset containing many sheets (feature types), and have to read them in the original order - from left to right shown in the Excel user interface. e.g. Sheet2 -> Sheet4 -> Sheet3 -> Sheet1 in the case shown in this screenshot.As long as I tested so far, FME seems to read the worksheets (feature types) in my desired order, but I'm not sure if it's guaranteed as the implementation of the Excel reader.Could you please confirm that it's guaranteed not only in the current and also in the future?

110

5 years ago

fer_ruizContributor

asked in Data

use the variable of an attribute for the name of a txt format writer

I would like to know how to put as a name of the writer of type txt, to put "frg_ (variable) .txt where what is in parentheses is the attribute that I want to put so as not to have to change it myself.

220

5 years ago

p.jeremieContributor

asked in Data

Excel writer : active tab selection

Hello, I wonder if it is possible to choose which tab will be the active one after the creation/update of a Excel workbook with the Excel Writer.In my workspace I update a Excel workbook in which I have an 'history' tab. This one seems to be the last updated by FME because every time I run the workspace it is this tab that is active when I re-open the file in Excel.What I want is to set active my first tab with the actual data in it so the final user won't need to change tab every time the file is updated by the workspace.Hope the question is clear enough.

Trouble accesing ArcGIS Portal error "doesn't appear to be an ArcGIS portal instance"

We have a new ArcGIS portal. Previously, we had no problems access feature service with the older portals. I tried accessing the new portal and I am getting an error that says "doesn't appear to be an ArcGIS portal instance." I worked with someone through chat. We were able to use the http caller and got a response, but still wasn't able to use the reader. Any assistance on this is appreciated.

I need to filter out IfcSpace polygons whose Other.Area Scheme Id values are shown as Sections. I can able to filter out these in Inspector's Query tool but I cannot able to filter the same in Workbench after extracting IfcSpace Geometry traits with GeometryPropertyExtractor transformer.

is there any kind of documentation for using the azure event grid subscriber?

Hello,I'm trying to use the azure event grid subscriber but the actual documentation doesn't specify how to send dynamic key/value:http://docs.safe.com/fme/2019.0/html/FME_Server_Documentation/ReferenceManual/Azure-Event-Grid-Subscriber.htmIdealy, I would hope we could parse some sort of "subscriber_content" through the TOPIC but we never managed to get anything working. We only succeeded in sending hard coded key/values.I would expect a list of keywords like in other subscribers but none are documented.Any idea?

DGN reader/writer embedded custom linestyles

Does FME support DGN reading/writing with so called embedded custom linestyles?

5 years ago

mstonewa

asked in Data

How to insert shapefile features into SDE and then populate a field based on the new OBJECTID's?

I need to add 26 points from 2 different shapefiles into an existing point feature class stored in an SDE. For the destination features, the "enclosureid" values should be equal to the automatically generated OBJECTID's

The IFC Rail Project in FME?

Is FME going to support IFC Rail Project? https://www.buildingsmart.org/standards/bsi-standards/standards-library/

160

5 years ago

agelfertContributor

asked in Data

Will DNS aliasing for SQL instances work with FME database connections?

I'm in the process of moving to SQL Server 2017 for ArcSDE. My plan is to use DNS aliasing to route any ESRI connections to my existing SQL instances (in case I miss any during updates of connection files) to the new 2017 instances. Database names won't change.Will this work for FME as well? I don't know how FME stores the connection info in the workspace. Mostly concerned with FME Server. Hopefully, there are no IPs stored anywhere!?So if I'm currently using:Instance: OldSQLBoxDatabase: MyOldDBWindows Authenticationand the new instance is called: NewSQLBox.Will my FME connection pointing at OldSQLBox, MyOldDB work once aliasing is setup and "traffic gets routes" to NewSQLBox, MyOldDB? (I'm sure you can tell from the jargon here that I'm no DBA - haha!)

Format txt output from HTTP Caller

I am using the HTTP Caller to GET information from an API.It responds well with a list in a txt file, formatting that list is not easy. I'm able to format in Power BI, but Excel never understands it because it doesn't have a 'common' common delimiter. Except it does, I know that there are three headers in that list that I need.nameuaiduriThese repeat throughout the text, and apart form the jargon at the start of the txt file, these seem to act like they should. PowerBi understands this format.I'd like to use this GET Caller and format the output within my workbench into the three columns so I can use the information to either import into a feature class or simply export as a table.I'm also looking at using the uaid to do another GET request for more information from this API, but you can't do the second request without the uaid from the first request. I think to do that I need the txt file to be formatted within the workbench.I've attached a small part o

Get snapping tolerance of a Microstation file v.8

I am reading a Microstation v.8 des file from FME. The file contains lines and I am trying to generate polygons with AreaBuilder. Sometimes I can't generate the areas since the lines don't touch. I think it is a snapping problem. How can I get the snapping tolerance defined in the Microstation v.8 file that I am reading in FME? Thank you.

5 years ago

adrian_farrellContributor

asked in Data

Oracle Non-Spatial Reader 8000 character limit

Hi Trying to read an Oracle table containing one (Oracle limit) "Long" datatype field The field only brings through the first 8000 characters into FME (these are typically upwards of 9800 characters in this DB) As an aside into Access (ODBC) it reads more (8135) but not all of the field Does anyone have any idea how to bypass this limit and bring in the huge field? Thanks Adrian

190

5 years ago

Page 98 / 273

Badge winners

chandcolehas earned the badge Teacher (Grey)
boostpadhas earned the badge FME Form Basic Training
nathanherzoghas earned the badge Student (Grey)
nathanherzoghas earned the badge Teacher (Grey)
adam_timmonshas earned the badge 12 Days 2024 Bronze Badge

Show all badges

30,414: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.