Using readers and writers to extract and load data.
Recently active
Hi Everybody,I need to configure my shapefile output with No fill Color and Outline Color red automatically. How make this?Thank´s
I have an input excel file that is the source some HTTP calls are made to fill in columns in the spreadsheet using a template file and a defined output file overwritten. It runs in workbench but fails when published with an error that I can't locate the function or () it is complaining about. I have searched the error log for the text in the error and can't find a parameter with out a ()?Function `XLSXW_OUT_TEMPLATEFILE_XLSXW_1' must be called with any parameters enclosed in ( ), even if there are none Some details are:FME Server 2016.0.1.1 - Build 16177 - win32 Copyright (c) 1994 - 2016, Safe Software Inc.Direct Url Examplehttp://CODC1ITS8SGS984:8080/fmedatadownload/fmeservices/rlc_routecm2rpt.fmw?ExcelAnswerrtcm2rpt=G%3A%5CRFWorkspace%5Crlcupload%5CrlcUpload1Answer.xlsx&ExcelInputrtcm2rpt=G%3A%5CRFWorkspace%5Crlclrs%5CrlcUpload1.xlsx&RLCExcelTemplateFile=G%3A%5CRFWorkspace%5CrlcTemplateFile%5CrlcUpload1Template.xlsx&opt_showresult=false&opt_servicemode=as
Hi,I have a set of PDF survey templates that I have written a workspace for to extract the infilled data from. I want to be able to add individual readers for each PDF to keep each survey separate. However when i select multiple files, even when individual feature types are selected it still only inserts one reader.Has anyone any ideas how to make FME add multiple readers, one for each PDF?Thanks in advance :)
Hi everyone So I've come across a weird issue. When ever I try to overwrite polygons on ArcGIS online using the ArcGIS Online Writer with the truncate option set to Yes I get a weird error saying something likeArcGIS Online Feature Service Writer: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was 'HTTPSConnectionPool(host='services1.arcgis.com', port=443): Max retries exceeded with url: (HERE IS MY PRIVATE LINK TO THE FEATURE SERVICE AND TOKEN INFORMATION SO I TOOK THAT PART OUT) (Caused by ProtocolError('Connection aborted.', error(10053, 'An established connection was aborted by the software in your host machine')))' A fatal error has occurred. Check the logfile above for details Points go in fine. Polygons go in fine the first time (Where the Feature Layer and the Feature Service don't exists....it creates them and sends in the data perfectly). But
I have an MXD that has all the layers (3 feature classes) reading from one file geodatabase. I would like FME to change the "Data Source" in the MXD from one geodatabase to another geodatabase. Can FME do this?Thanks
Is their a way to set my file geodatabase writer to comress itself somehow?
Hi All, I am trying to update an SDE featureclass with a list containing a selection of records in that featureclass. I'm a little stuck as to how I can update just the records in the list - there is only one field that requires updating in the featureclass. I feel I need to push the list into a parameter and have that parameter in the "SQL To Run Before Write" feature in the Writer.Does this sound feasible or am I off track with this one? I'm sure there's a few ways to do this.Any help with this would be appreciated.Cheers,Mike
FME Server 2019.0.0.1 Build 19246 - linux-x64, JavaScript Library Version 3I noticed that the datetime format of timeStarted and timeFinished returned by the FMEServer.runDataDonwlod function is "%Y-%m-%d %I:%M:%S" without %p (AM/PM).Since "%I" is in the range 00-12, you cannot get correct started/finished datetime in afternoon.This is the result from a quick test.Could you please investigate the format of these timestamp members?{ "serviceResponse" : { "statusInfo" : { "mode" : mode, "status" : status }, "fmeTransformationResult" : { "fmeServerResponse" : { "id" : id, "jobStatus" : status, "result" : result_string, "resultSuccess" : true_or_false, "serviceMsg" : msg, "serviceSuccess" : true_or_false, "timeRequested" : timestamp, "timeStarted" : timestamp, "timeFinished" : timestamp, "requesterResultPort" :
I’m wondering if it is possible to use FME to generate tile sets/packages that I can then load to ArcGIS Online as a tile/map service? I’m looking for ways to cut down on those pesky AGOL credits and if I could use FME to generate them locally it sure would save a lot!
Is there a change in I'm re-creating a Workspace in 64-bit Desktop 2017.1.1.0 (17650). The Workspace takes a ShapeFile of line data and process it in varies ways, including Aggregating on 3 fields - Geometry - Assemble One Level, Drop Incoming Attributes, Homogenous Collection (If Possible) - and writing to a File Geodatabase.The old Workspace included an Aggregator transformer version 11 and works in FME 2016.1. However in 2017.1.1 with Aggregator version 14 I get 35 fewer features in the File Geodatabase. The rejected features are logged like this:2017-10-16 12:39:14| 92.3| 0.1|WARN |FileGDB Writer: Failed to write Geometry to feature class 'roads_classnumber' with geometry type 'esriGeometryPolyline'. Dropping containing feature 2017-10-16 12:39:14| 92.3| 0.0|STATS |Storing feature(s) to FME feature store file `X:\\x_log.ffs' 2017-10-16 12:39:14| 92.3| 0.0|WARN |+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2017-10-1
I am trying to query elasticsearch using fme to find the most recent date in a document. when I run it in kibana console as :POST officeearthsearch/earthsearch/_search{ "_source": ["CHANGED_DATE"], "query": { "match_all": {} }, "size": 1, "sort": [ { "CHANGED_DATE": { "order": "desc" } } ]}it works and returns a single record containing the most recent changed date.In the fme elasticsearch reader I input into the JSON query:{ "query": { "match_all": {} }, "size": 1, "sort": [ { "CHANGED_DATE": { "order": "desc" } } ]}and get the following error:FME API version of module 'ELASTICSEARCH' matches current internal version (3.8 20170315)ELASTICSEARCH reader: Directive '_HOST' has value 'search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com:80'ELASTICSEARCH reader: Directive '_RAW_JSON' has value 'No'ELASTICSEARCH reader: Directive '_NUM_FEATURES_PER_REQUEST' has value '1'ELASTICSEARCH reader: Directive '_
I'm trying to cycle through a bunch of input shapefiles using a reader path as follows: C:\\my_project\\my_data\\**\\my_shape.shp However, some of the folders represented by ** contain characters from the Russian alphabet and this seems to be causing the reader to loop round and round without error or warning. Is there a way of testing a path for unrecognised characters and skipping it? (FME 2018.1)
I am trying to populate one attribute field (Main) based on a spatial relationship in a file geodatabase. I have mains and laterals. Our mains have a field called "Main_ID". I want to populate our lateral attribute field "Main" based on the main that the lateral touches. Seems like a pretty simple problem. I've tried the spatial relator, but that actually adds the geometry (essentially doubling the number of laterals). I don't want to write out or replace any geometry, just populate that one attribute field. Any suggestions?
Hello all, I have added shapefiles to an Azure DB. To add the geometry into the database, I used the Geometry Extractor set to GeoJSON. After reviewing the geometry coordinate list within the Azure DB against the GeometryExtractor geometry populated field, the DB geometry field has additional vertices. This is mostly occurring with polygons that have curves. I'm not sure why this is occurring. Has anyone run into this before?This is causing a problem when checking for changes. As now some polygons are slightly off. Thanks! David
Hello,I'm currently working on the following case. We need to generate a report in Word (using MSWord reader). This report will include a picture based on selected features from an ESRI FileGeodatabase. As background to these features we want to add some topology (from a WMS).A colleague suggested the ImageFetcher transformer to me to get the image from the WMS.I'm able to run it without errors, but the end result is the selected features (in this case three lines) on a white background.Does anyone have an idea what could go wrong here? I've tried various other WMS links (from different organisations) to verify if there might be a fault in the WMS, but all of them give the same white background as a result.I'm using FME 2018.1.2.0, build 18590
Hi, Im working on worspace that already has a subscription connected to a Topic Message. So when a new file is added to a specific folder, a Topic Message with the file path is sent as JSON. Depending on the name of the filepath I use a TestFilter to determine which test I want to do. This works! However, after choosing the test, I want to retrieve the file and further test the data. As the filepath is knowned and stored, I tried using a FeatureReader to open it, but it doesn´t work... Does anyone have a suggestion on how this can be fixed?
Hi!I want to interpolate the terrain model (black line) down in the terrrain. Below shown in orange is 4 points with z value - 10, -5, -1 and -7. To keep the terrain formations similar I want to shift the whole surface/triangle down at certain points. So the new terrain model is not the RED lines, but the yellow lines. Any easy way to shift certain triangle- edges down and have all the connected triangles also "move down"? Not sure if there is a better way to explain this :)
I made a workspace to automatically download spatial information from an API using the HTTPCaller. The API replies with a .zip file, with .shp files within these .zip files. In this workspace I want to unzip the API’s response and import the shapefiles into my PostGIS database. I use the unzipper to unzip the shapefiles and the tester to filter the .shp files. I use the AttributeKeeper to filter all the unused attributes. Then I want to use the “windows_path” attribute as a data source for the FeatureReader (in this case its 23 different .shp files). My goal is to write each shapefile into my database dynamically using the fme_feature_type as Table Name. It has to be dynamical since I want to use this workspace to download different datasets from the API.My workspace doesn't work no matter what I try, and i don't know what I'm doing wrong.When I open the FeatureReader, it looks like this: When I run this it shows no attributes, since I still have to expose them all.I tried
If someone of you gives me a help, I will be eternally grateful. I'm just taking my first step and I'm alrady confused.
Hello everyoneI have a directory of PDF files and would like to select some of them for merging.Is there a way of merging a list of PDF files to a multi-page PDF file?Thanks.
Hello,I have a question regarding the PCD Writer. I am trying to write a .xyz point cloud (consisting of ~ 2 million points) to the PCD format. The point cloud represents a segment of a tunnel-like geometry. The output cloud has regular strokes of missing points. From certain angles the point cloud appears to be complete, but when orbitting around one can see these strokes of missing data. Imagine slicing bread and removing every other slice.Any ideas on what could cause this issue? Thanks!
Hi, I have a MapInfo tab file which contains around 390,000 features some of the features are not displayed in the Map window. After some investigation it appears that tab file contains some features that are ‘not objects’. I’ll call this ‘spurious data’. My current process to remove the spurious data is to use SQL Select and apply the condition 'not obj' (see screen shot below). This identifies around 14,000 features which can then be removed. I naively thought, as the spurious data apparently has ‘no object’ and cannot be displayed in MapInfo , FME would automatically identify these features in a similar way and somehow inform me, at which point I'd use the relevant transformer to remove them. Unfortunately in this case FME reads all the data as valid data and when I attach an inspector it displays all the features !?!Could someone please advise me on what transformer and / or parameter I need to use to stop features which are not objects to be removed?Screen shot below s
i can finish ifc to standard citygml ,but the conversion between ifc to citygml ade has some propblem ,such as " The 'lod4Geometry' citygml_lod_name trait is invalid for 'Stair' features, the geometry will be ignored, valid values are {lod4MultiSurface}." when i set the citygml_lod_name value is lod4MultiSurface,there has more error,how should i set the CityGMLGeometrySetter transformer?
HiI'm having problem connectiong to Cambridge dataset in smallworld.my FME version is 2009 and I'm using smallworld core 4.0 , also i have tested it on smallworld core 4.2 with the same error.The full log is attached.Best regards,Aramideh
I cannot get hyperlinks to work when using a dynamic excel writer using schema. This is how I hook the hyperlink up to the file_path field.Basically just creating a new attribute as suggested in the manual: file_path.hyperlinkI get no errors but there are no hyperlinks in the written excel-file.Does anyone have a workaround for this?