Using readers and writers to extract and load data.
Recently active
Hi, I'm attempting to use the FeatureWriter transformer to write intermediate data in my workspace. The issue I'm running into, is that unlike in Esri's ModelBuilder, I can't connect that output/writer to another transformer, which is what I need to do. Because I'm working with Esri feature classes (in file geodatabases and SDE geodatabases), the formatting of files needs to be just-so. If I'm starting with a .xlsx file and would like to eventually perform spatial analysis on the data, I need the ability to write it to an Esri-friendly format ( geodatabase table) before I can start editing fields, completing joins, etc. I can get the workspace to the point of writing the .xlsx table to a .gdb table, but I'm not sure how to use the FeatureWriter transformer to continue the analysis I need to do on the .gdb table in the same workspace since that transformer doesn't offer any output ports to connect the dataset to another transformer.
Hello, I downloaded a trial of FME desktop , and I was trying to extend it to Revit , it keeps saying I should run it as an administrator , which I did , but it still didn't work. please advise what should I do
Hi! I have been googling PostGIS-3D-solutions so hard that my finger tips are getting sore. Basically I need to create 3D solids and store them in PostGIS from mainly Autocad data (preferably with FME). Then I want to be able to store 3D points in the same database and query if they are inside the body of the solid or not. As simple as that. Any suggestions or links will be appreciated!
Hi,We are currently using AutoCAD Map 3D and use Oracle spatial database for storing spatial data. We are going through FME software like to know :1. Can FME support moving DWG to NOSQL database (like MongoDB support ) ?2. For Oracle spatial can FME handle and save blocks as well ?
I am using FME 2018.0 desktop, and writing to a DWG with the AutoCAD Writer (in a feature writer) with a template file which has a large number of blocks. However, not all the blocks are used by the output file that is being written. I have set the writer to "purge unused objects" in the hope it will remove the unused blocks when it writes the output CAD file. However, the unused blocks are still being included in the output file. Has anyone else experienced this issue and/or found a way to resolve it? Could it be an issue with my template file? Below is the information I found about this writer feature in the FME Documentation.PURGEThis directive can be used to turn on/off purging of unused objects or entities before the final drawing file is written out. Unused objects are those which are not referenced by other objects in the drawing. For example, for a layer to be eligible to be purged, there must be no entities on that layer. If turned on, the AutoCAD Writer will attemp
Hey Everyone,My group has a number of dwg files that are multi-vector diagrams of a structure. The final output would be a GDB environment. Writing to a GDB is easy enough but there is no coordinate information attached to it. The template is meant to be placed anywhere we desire on the planet. If there was a center point in the middle of the multiple vectors, is it possible to have FME reference everything to the coordinates point that are supplied by the user?
I need to write attributes in a custom tab, basically like any of the blue tabs that can be seen here:(the viewer used is Solibri MV; the model is the top example found here: http://www.ifcwiki.org/index.php?title=KIT_IFC_Examples ). I've tried the AttributeCreator, but the property set doesn't even get written. The method however does work, as standard properties like Identity Data do end up in the IFC:I also tried the IFCPropertySetDefinitionCreator, but this doesn't produce any empty propety set either (nor do I know how to write values to it). Can FME even write custom attributes?
Hi there, is it possible to use the pointcloud filter transformer with a a componenttype = string? I have a pointcloud (csv) with a component (RCx) that contains numeric values but there are also "N/A" string values (Nodata) in this component. In the pointcloud filter a made the expression "@Component(RCx) == N/A" but its not working. Has anyone an idea how to filter thes Nodata values with a pointcloudfilter expression?
Hi, I would like to know hot to define the texts beginnig and end.I have got : Attribute: Adressen_kalkuliert_drop_loc D-L-143245-143245-F-45--1xMICRO-DUCT-12x10-6MMD-F-422-F-471--1xMICRO-DUCT-12x10-6MM(a tousands of them) and need to define Attribute Value: L-143245 (from the first one) andF-422 (from the second one) the texts are always different, and have a different number of numbersBut beginns alway with "F", or "L" and ends always with "-" behind the number. thanks
Hi,I am new to FME and I try to generate several PDFs with map-content at once.I am struggeling with the creation of a dynamic scale bar. My Inputdataset is a Shapefile with a lot of polygons I want to iterate through. I need to zoom on every single feature and generate a PDF (for every single feature). Because of big differences in the size of the features, a static scalebar-Image would be no Option.Im thinking about a pythonscript to fill a mxd-template and generate the pdf with arcpy.Is there no fme-way to solve the whole problem without a workaround?Furthermore it would be great to zoom in steps to even scales.Thank u very much
Hi Everybody,I need to configure my shapefile output with No fill Color and Outline Color red automatically. How make this?Thank´s
I have an input excel file that is the source some HTTP calls are made to fill in columns in the spreadsheet using a template file and a defined output file overwritten. It runs in workbench but fails when published with an error that I can't locate the function or () it is complaining about. I have searched the error log for the text in the error and can't find a parameter with out a ()?Function `XLSXW_OUT_TEMPLATEFILE_XLSXW_1' must be called with any parameters enclosed in ( ), even if there are none Some details are:FME Server 2016.0.1.1 - Build 16177 - win32 Copyright (c) 1994 - 2016, Safe Software Inc.Direct Url Examplehttp://CODC1ITS8SGS984:8080/fmedatadownload/fmeservices/rlc_routecm2rpt.fmw?ExcelAnswerrtcm2rpt=G%3A%5CRFWorkspace%5Crlcupload%5CrlcUpload1Answer.xlsx&ExcelInputrtcm2rpt=G%3A%5CRFWorkspace%5Crlclrs%5CrlcUpload1.xlsx&RLCExcelTemplateFile=G%3A%5CRFWorkspace%5CrlcTemplateFile%5CrlcUpload1Template.xlsx&opt_showresult=false&opt_servicemode=as
Hi,I have a set of PDF survey templates that I have written a workspace for to extract the infilled data from. I want to be able to add individual readers for each PDF to keep each survey separate. However when i select multiple files, even when individual feature types are selected it still only inserts one reader.Has anyone any ideas how to make FME add multiple readers, one for each PDF?Thanks in advance :)
Hi everyone So I've come across a weird issue. When ever I try to overwrite polygons on ArcGIS online using the ArcGIS Online Writer with the truncate option set to Yes I get a weird error saying something likeArcGIS Online Feature Service Writer: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was 'HTTPSConnectionPool(host='services1.arcgis.com', port=443): Max retries exceeded with url: (HERE IS MY PRIVATE LINK TO THE FEATURE SERVICE AND TOKEN INFORMATION SO I TOOK THAT PART OUT) (Caused by ProtocolError('Connection aborted.', error(10053, 'An established connection was aborted by the software in your host machine')))' A fatal error has occurred. Check the logfile above for details Points go in fine. Polygons go in fine the first time (Where the Feature Layer and the Feature Service don't exists....it creates them and sends in the data perfectly). But
I have an MXD that has all the layers (3 feature classes) reading from one file geodatabase. I would like FME to change the "Data Source" in the MXD from one geodatabase to another geodatabase. Can FME do this?Thanks
Is their a way to set my file geodatabase writer to comress itself somehow?
Hi All, I am trying to update an SDE featureclass with a list containing a selection of records in that featureclass. I'm a little stuck as to how I can update just the records in the list - there is only one field that requires updating in the featureclass. I feel I need to push the list into a parameter and have that parameter in the "SQL To Run Before Write" feature in the Writer.Does this sound feasible or am I off track with this one? I'm sure there's a few ways to do this.Any help with this would be appreciated.Cheers,Mike
FME Server 2019.0.0.1 Build 19246 - linux-x64, JavaScript Library Version 3I noticed that the datetime format of timeStarted and timeFinished returned by the FMEServer.runDataDonwlod function is "%Y-%m-%d %I:%M:%S" without %p (AM/PM).Since "%I" is in the range 00-12, you cannot get correct started/finished datetime in afternoon.This is the result from a quick test.Could you please investigate the format of these timestamp members?{ "serviceResponse" : { "statusInfo" : { "mode" : mode, "status" : status }, "fmeTransformationResult" : { "fmeServerResponse" : { "id" : id, "jobStatus" : status, "result" : result_string, "resultSuccess" : true_or_false, "serviceMsg" : msg, "serviceSuccess" : true_or_false, "timeRequested" : timestamp, "timeStarted" : timestamp, "timeFinished" : timestamp, "requesterResultPort" :
I’m wondering if it is possible to use FME to generate tile sets/packages that I can then load to ArcGIS Online as a tile/map service? I’m looking for ways to cut down on those pesky AGOL credits and if I could use FME to generate them locally it sure would save a lot!
Is there a change in I'm re-creating a Workspace in 64-bit Desktop 2017.1.1.0 (17650). The Workspace takes a ShapeFile of line data and process it in varies ways, including Aggregating on 3 fields - Geometry - Assemble One Level, Drop Incoming Attributes, Homogenous Collection (If Possible) - and writing to a File Geodatabase.The old Workspace included an Aggregator transformer version 11 and works in FME 2016.1. However in 2017.1.1 with Aggregator version 14 I get 35 fewer features in the File Geodatabase. The rejected features are logged like this:2017-10-16 12:39:14| 92.3| 0.1|WARN |FileGDB Writer: Failed to write Geometry to feature class 'roads_classnumber' with geometry type 'esriGeometryPolyline'. Dropping containing feature 2017-10-16 12:39:14| 92.3| 0.0|STATS |Storing feature(s) to FME feature store file `X:\\x_log.ffs' 2017-10-16 12:39:14| 92.3| 0.0|WARN |+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2017-10-1
I am trying to query elasticsearch using fme to find the most recent date in a document. when I run it in kibana console as :POST officeearthsearch/earthsearch/_search{ "_source": ["CHANGED_DATE"], "query": { "match_all": {} }, "size": 1, "sort": [ { "CHANGED_DATE": { "order": "desc" } } ]}it works and returns a single record containing the most recent changed date.In the fme elasticsearch reader I input into the JSON query:{ "query": { "match_all": {} }, "size": 1, "sort": [ { "CHANGED_DATE": { "order": "desc" } } ]}and get the following error:FME API version of module 'ELASTICSEARCH' matches current internal version (3.8 20170315)ELASTICSEARCH reader: Directive '_HOST' has value 'search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com:80'ELASTICSEARCH reader: Directive '_RAW_JSON' has value 'No'ELASTICSEARCH reader: Directive '_NUM_FEATURES_PER_REQUEST' has value '1'ELASTICSEARCH reader: Directive '_
I'm trying to cycle through a bunch of input shapefiles using a reader path as follows: C:\\my_project\\my_data\\**\\my_shape.shp However, some of the folders represented by ** contain characters from the Russian alphabet and this seems to be causing the reader to loop round and round without error or warning. Is there a way of testing a path for unrecognised characters and skipping it? (FME 2018.1)
I am trying to populate one attribute field (Main) based on a spatial relationship in a file geodatabase. I have mains and laterals. Our mains have a field called "Main_ID". I want to populate our lateral attribute field "Main" based on the main that the lateral touches. Seems like a pretty simple problem. I've tried the spatial relator, but that actually adds the geometry (essentially doubling the number of laterals). I don't want to write out or replace any geometry, just populate that one attribute field. Any suggestions?
Hello all, I have added shapefiles to an Azure DB. To add the geometry into the database, I used the Geometry Extractor set to GeoJSON. After reviewing the geometry coordinate list within the Azure DB against the GeometryExtractor geometry populated field, the DB geometry field has additional vertices. This is mostly occurring with polygons that have curves. I'm not sure why this is occurring. Has anyone run into this before?This is causing a problem when checking for changes. As now some polygons are slightly off. Thanks! David
Hello,I'm currently working on the following case. We need to generate a report in Word (using MSWord reader). This report will include a picture based on selected features from an ESRI FileGeodatabase. As background to these features we want to add some topology (from a WMS).A colleague suggested the ImageFetcher transformer to me to get the image from the WMS.I'm able to run it without errors, but the end result is the selected features (in this case three lines) on a white background.Does anyone have an idea what could go wrong here? I've tried various other WMS links (from different organisations) to verify if there might be a fault in the WMS, but all of them give the same white background as a result.I'm using FME 2018.1.2.0, build 18590