Using readers and writers to extract and load data.
Recently active
Hi all, I’m using Google Drive Connector to download a folder contains images to process them later and convert them to points feature class. When I rerun my workbench I got an error from google drive connector said that the destination exists and when I delete this folder my workbench works fine.Is there anyway that I could setup my Google Drive connector to overwrite the existing folder or anyway to delete that folder through the workbench it self before the google drive start download it again? Thanks,Rawan
Hi Everyone, I hope that someone might be able to provide some guidance or suggestions on a task I am attempting with FME. My team is in the process of cleaning up our GIS data, and as part of this clean-up effort I have been asked to determine all of the records (from various attribute fields) that contain 9999 across all feature classes. So for example, Feature class A may have attributes in the 'Material' field with a value of 9999, Feature class B may have Diameter with 9999, Feature class C could have Install Year and Material with 9999, etc.. Is there a simple way to perform this task to search for all 9999 values across all feature classes? I would appreciate any assistance that could be provided! Thank you,Shelley
I have an FME Server Automation, triggered as a schedule, that has these basic steps: Reads binary files from a SFTPS site and writes to staging folder (A)Reads binary files from staging folder (A), decode files, and writes out to staging folder (B)Reads decoded files from the staging folder (B) and writes to a Vertica databaseCleans up on staging folders (A) and (B), ready for next schedule The decoding bit in step (2) takes its file input from a PATH Reader and can take some time to finish, so I run the workspace in parallel against a FME Server queue across 4 engines. My issue is that the Automation moves to step (3) as soon as 1 of the 4 engines becomes available. Step (3) and step (4) are fast and complete before the remaining 3 engines running step (2) complete. This results is 3 files arriving in the staging folder (B) after the Automation has finished. QUESTION: Is there a ”simple” way to make the Automation wait until step (2) has fully completed on all 4 engines, before m
Hi,I have a problem encoding a text file to the correct format. The below images show:1) the *.prj document properties of an outputted Terrascan Project from a Matlab programme:2) the *.prj document properties of an outputted Terrascan Project from an FME Workbench.Only the file at 1 can be loaded directly in to Terrascan.If the file at 2 is "Saved as" in Textpad, the option to change the line ending to "PC" is available as shown below.In doing so, the file will then load in correctly into Terrascan. Please advise where I maybe going wrong.The template workbench as a small selection of the files is below:Any assistance the can be offered would be much appreciated!
the problem when i see data in pgadmin i cant perview data correct . however it is shown in fme inspector fme2019.1
Hello I have a problem,I try to read multiple csv from an URL that changes.An exemple of URL : https://archive.luftdaten.info/2019-11-11/2019-11-11_sds011_sensor_26828.csvhttps://archive.luftdaten.info/2019-11-11/2019-11-11_sds011_sensor_26760.csvI tried to use an HTTPCaller and it works but I don't know how to treat the result. I don't find any transformer that can help me to translate this string "csv" into a list of attribute. If someone can help me it could be great please. Here are two images of what I get with httpcaller :
Hello, have a excel sheet with more then 20.000 records and only two columns. I want to divide the two columns into 7 columns: The problem now sits in the PART_COLOR, not every row has a color, see my result: Is there anyone who can help me with this "little" problem? I will explain what my workflow now is:StringSearcher: I search for the string "SET NR001" in the Description column. So I only get this value's instead of all the other ones. (about 90 different parts).AttributeSplitter: split the Description column on every "space" and put them in lists.AttributeManager: create outputs for every list.AttributeCreator: create the different outputs for the different inputs, for the "Name" output I use list5 + list6. Perhaps I am using the wrong tools, but I am a starting user at FME.
HiI want to convert polygon shp to cad hatch,everything is fine ,except the hatch geometry attribute only have elevation ,the area is missing(we badly need it in production environment). I do some test, find out that may be the area attribute is assosiate with hatch boundary. is there a way I can do to get area attribute wirte in cad hatch in FME workbench?Thanks in advance
Here is the error that I get when the translation fails: "Unexpected execution path. Please contact Safe Software GeodatabaseRelationshipFeaturesPipeline::GeodatabaseRelationshipFeatures(SortFactory): A fatal error has occurred. Check the logfile above for details. Some error has occurred closing the pipeline factory, see previous warning None of the edits made during the edit session were saved."I'm using the Data Interoperability Extension through ESRI (ArcGIS 10.4.1). I am new to spatial ETL processes, but I followed the FME tutorial on Writing to Relationship Classes so I believe that the workflow is set-up properly. I haven't found much doc on this issue, so I'm reaching out to the experts for help on this.Thanks!!
Hello,I'm trying to create the worspace that I need to publish and automate later in FME Server.There are 2 SDE Datasets, lets say the Set "A" and "B".I have to delete some feature types (that contains also Relationships, Tables etc.) from Set A (also Domains!) and write new (actuel) feature types from set "B" into the Set "A" (of course with the domains). Do you have an idea / model of the workspace? At the beginning I do not try to test this with a .SDE-Reader, but with .GDB.Thanks for all tipps!
I am trying to find out how to route email to FME Server so Publications can pick it up and process accordingly. The problem is that I cannot find anything in any tutorial or piece of documentation. Here's a scenario:We use Office 365 and use email in the form <first.lastname@company.com>I would like to set up a subdomain so email sent to @fme.company.com is routed to the fme server at fme.company.comMy understanding is that an MX record needs to be set up on the firewall. The primary email server receives all email addressed to @company.com. It would then need to know what to do with email addressed to a subdomain, so if an MX record exists, it knows to forward/route to a different SMTP server. If the subdomain is unknown, it would bounce back with an error message to the sender. Hope I'm getting this right and it makes sense.However I'm not sure what else needs to be set up in order to route SMTP traffic to FME Server. Any help would be greatly appreciated, especial
Hello, I have an Excel dataset containing many sheets (feature types), and have to read them in the original order - from left to right shown in the Excel user interface. e.g. Sheet2 -> Sheet4 -> Sheet3 -> Sheet1 in the case shown in this screenshot.As long as I tested so far, FME seems to read the worksheets (feature types) in my desired order, but I'm not sure if it's guaranteed as the implementation of the Excel reader.Could you please confirm that it's guaranteed not only in the current and also in the future?
I would like to know how to put as a name of the writer of type txt, to put "frg_ (variable) .txt where what is in parentheses is the attribute that I want to put so as not to have to change it myself.
Hello, I wonder if it is possible to choose which tab will be the active one after the creation/update of a Excel workbook with the Excel Writer.In my workspace I update a Excel workbook in which I have an 'history' tab. This one seems to be the last updated by FME because every time I run the workspace it is this tab that is active when I re-open the file in Excel.What I want is to set active my first tab with the actual data in it so the final user won't need to change tab every time the file is updated by the workspace.Hope the question is clear enough.
We have a new ArcGIS portal. Previously, we had no problems access feature service with the older portals. I tried accessing the new portal and I am getting an error that says "doesn't appear to be an ArcGIS portal instance." I worked with someone through chat. We were able to use the http caller and got a response, but still wasn't able to use the reader. Any assistance on this is appreciated.
I need to filter out IfcSpace polygons whose Other.Area Scheme Id values are shown as Sections. I can able to filter out these in Inspector's Query tool but I cannot able to filter the same in Workbench after extracting IfcSpace Geometry traits with GeometryPropertyExtractor transformer.
Hello,I'm trying to use the azure event grid subscriber but the actual documentation doesn't specify how to send dynamic key/value:http://docs.safe.com/fme/2019.0/html/FME_Server_Documentation/ReferenceManual/Azure-Event-Grid-Subscriber.htmIdealy, I would hope we could parse some sort of "subscriber_content" through the TOPIC but we never managed to get anything working. We only succeeded in sending hard coded key/values.I would expect a list of keywords like in other subscribers but none are documented.Any idea?
Does FME support DGN reading/writing with so called embedded custom linestyles?
I need to add 26 points from 2 different shapefiles into an existing point feature class stored in an SDE. For the destination features, the "enclosureid" values should be equal to the automatically generated OBJECTID's
Is FME going to support IFC Rail Project? https://www.buildingsmart.org/standards/bsi-standards/standards-library/
I'm in the process of moving to SQL Server 2017 for ArcSDE. My plan is to use DNS aliasing to route any ESRI connections to my existing SQL instances (in case I miss any during updates of connection files) to the new 2017 instances. Database names won't change.Will this work for FME as well? I don't know how FME stores the connection info in the workspace. Mostly concerned with FME Server. Hopefully, there are no IPs stored anywhere!?So if I'm currently using:Instance: OldSQLBoxDatabase: MyOldDBWindows Authenticationand the new instance is called: NewSQLBox.Will my FME connection pointing at OldSQLBox, MyOldDB work once aliasing is setup and "traffic gets routes" to NewSQLBox, MyOldDB? (I'm sure you can tell from the jargon here that I'm no DBA - haha!)
I am using the HTTP Caller to GET information from an API.It responds well with a list in a txt file, formatting that list is not easy. I'm able to format in Power BI, but Excel never understands it because it doesn't have a 'common' common delimiter. Except it does, I know that there are three headers in that list that I need.nameuaiduriThese repeat throughout the text, and apart form the jargon at the start of the txt file, these seem to act like they should. PowerBi understands this format.I'd like to use this GET Caller and format the output within my workbench into the three columns so I can use the information to either import into a feature class or simply export as a table.I'm also looking at using the uaid to do another GET request for more information from this API, but you can't do the second request without the uaid from the first request. I think to do that I need the txt file to be formatted within the workbench.I've attached a small part o
I am reading a Microstation v.8 des file from FME. The file contains lines and I am trying to generate polygons with AreaBuilder. Sometimes I can't generate the areas since the lines don't touch. I think it is a snapping problem. How can I get the snapping tolerance defined in the Microstation v.8 file that I am reading in FME? Thank you.
Hi Trying to read an Oracle table containing one (Oracle limit) "Long" datatype field The field only brings through the first 8000 characters into FME (these are typically upwards of 9800 characters in this DB) As an aside into Access (ODBC) it reads more (8135) but not all of the field Does anyone have any idea how to bypass this limit and bring in the huge field? Thanks Adrian
Hi,I would like to convert an IFC model to a format which is accepted by Cesium, but with respect to alloriginal individual elements. I am not looking to write everything to one single OBJ or DAE. The goal is to have every element selectable in Cesium.I know there is this documented workflow: https://www.mdpi.com/2220-9964/7/10/393/htm But I was wondering if there is a solution in FME. Anyone? Jasper