Data

I’m wondering if it is possible to use FME to generate tile sets/packages that I can then load to ArcGIS Online as a tile/map service? I’m looking for ways to cut down on those pesky AGOL credits and if I could use FME to generate them locally it sure would save a lot!

Is there a change in I'm re-creating a Workspace in 64-bit Desktop 2017.1.1.0 (17650). The Workspace takes a ShapeFile of line data and process it in varies ways, including Aggregating on 3 fields - Geometry - Assemble One Level, Drop Incoming Attributes, Homogenous Collection (If Possible) - and writing to a File Geodatabase.The old Workspace included an Aggregator transformer version 11 and works in FME 2016.1. However in 2017.1.1 with Aggregator version 14 I get 35 fewer features in the File Geodatabase. The rejected features are logged like this:2017-10-16 12:39:14| 92.3| 0.1|WARN |FileGDB Writer: Failed to write Geometry to feature class 'roads_classnumber' with geometry type 'esriGeometryPolyline'. Dropping containing feature 2017-10-16 12:39:14| 92.3| 0.0|STATS |Storing feature(s) to FME feature store file `X:\\x_log.ffs' 2017-10-16 12:39:14| 92.3| 0.0|WARN |+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2017-10-1

I am trying to query elasticsearch using fme to find the most recent date in a document. when I run it in kibana console as :POST officeearthsearch/earthsearch/_search{ "_source": ["CHANGED_DATE"],  "query": {    "match_all": {}  },  "size": 1,  "sort": [    {      "CHANGED_DATE": {        "order": "desc"      }    }  ]}it works and returns a single record containing the most recent changed date.In the fme elasticsearch reader I input into the JSON query:{  "query": {    "match_all": {}  },  "size": 1,  "sort": [    {      "CHANGED_DATE": {        "order": "desc"      }    }  ]}and get the following error:FME API version of module 'ELASTICSEARCH' matches current internal version (3.8 20170315)ELASTICSEARCH reader: Directive '_HOST' has value 'search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com:80'ELASTICSEARCH reader: Directive '_RAW_JSON' has value 'No'ELASTICSEARCH reader: Directive '_NUM_FEATURES_PER_REQUEST' has value '1'ELASTICSEARCH reader: Directive '_

I'm trying to cycle through a bunch of input shapefiles using a reader path as follows: C:\\my_project\\my_data\\**\\my_shape.shp However, some of the folders represented by ** contain characters from the Russian alphabet and this seems to be causing the reader to loop round and round without error or warning. Is there a way of testing a path for unrecognised characters and skipping it? (FME 2018.1)

I am trying to populate one attribute field (Main) based on a spatial relationship in a file geodatabase. I have mains and laterals. Our mains have a field called "Main_ID". I want to populate our lateral attribute field "Main" based on the main that the lateral touches. Seems like a pretty simple problem. I've tried the spatial relator, but that actually adds the geometry (essentially doubling the number of laterals). I don't want to write out or replace any geometry, just populate that one attribute field. Any suggestions?

Hello all, I have added shapefiles to an Azure DB. To add the geometry into the database, I used the Geometry Extractor set to GeoJSON. After reviewing the geometry coordinate list within the Azure DB against the GeometryExtractor geometry populated field, the DB geometry field has additional vertices. This is mostly occurring with polygons that have curves. I'm not sure why this is occurring. Has anyone run into this before?This is causing a problem when checking for changes. As now some polygons are slightly off. Thanks! David

Hello,I'm currently working on the following case. We need to generate a report in Word (using MSWord reader). This report will include a picture based on selected features from an ESRI FileGeodatabase. As background to these features we want to add some topology (from a WMS).A colleague suggested the ImageFetcher transformer to me to get the image from the WMS.I'm able to run it without errors, but the end result is the selected features (in this case three lines) on a white background.Does anyone have an idea what could go wrong here? I've tried various other WMS links (from different organisations) to verify if there might be a fault in the WMS, but all of them give the same white background as a result.I'm using FME 2018.1.2.0, build 18590

Hi, Im working on worspace that already has a subscription connected to a Topic Message. So when a new file is added to a specific folder, a Topic Message with the file path is sent as JSON. Depending on the name of the filepath I use a TestFilter to determine which test I want to do. This works!  However, after choosing the test, I want to retrieve the file and further test the data. As the filepath is knowned and stored, I tried using a FeatureReader to open it, but it doesn´t work... Does anyone have a suggestion on how this can be fixed?

Hi!I want to interpolate the terrain model (black line) down in the terrrain. Below shown in orange is 4 points with z value - 10, -5, -1 and -7. To keep the terrain formations similar I want to shift the whole surface/triangle down at certain points. So the new terrain model is not the RED lines, but the yellow lines. Any easy way to shift certain triangle- edges down and have all the connected triangles also "move down"? Not sure if there is a better way to explain this :)

I made a workspace to automatically download spatial information from an API using the HTTPCaller. The API replies with a .zip file, with .shp files within these .zip files. In this workspace I want to unzip the API’s response and import the shapefiles into my PostGIS database. I use the unzipper to unzip the shapefiles and the tester to filter the .shp files. I use the AttributeKeeper to filter all the unused attributes. Then I want to use the “windows_path” attribute as a data source for the FeatureReader (in this case its 23 different .shp files). My goal is to write each shapefile into my database dynamically using the fme_feature_type as Table Name. It has to be dynamical since I want to use this workspace to download different datasets from the API.My workspace doesn't work no matter what I try, and i don't know what I'm doing wrong.When I open the FeatureReader, it looks like this: When I run this it shows no attributes, since I still have to expose them all.I tried

If someone of you gives me a help, I will be eternally grateful. I'm just taking my first step and I'm alrady confused.

Hello everyoneI have a directory of PDF files and would like to select some of them for merging.Is there a way of merging a list of PDF files to a multi-page PDF file?Thanks.

Hello,I have a question regarding the PCD Writer. I am trying to write a .xyz point cloud (consisting of ~ 2 million points) to the PCD format. The point cloud represents a segment of a tunnel-like geometry. The output cloud has regular strokes of missing points. From certain angles the point cloud appears to be complete, but when orbitting around one can see these strokes of missing data. Imagine slicing bread and removing every other slice.Any ideas on what could cause this issue? Thanks!

Hi, I have a MapInfo tab file which contains around 390,000 features some of the features are not displayed in the Map window. After some investigation it appears that tab file contains some features that are ‘not objects’. I’ll call this ‘spurious data’. My current process to remove the spurious data is to use SQL Select and apply the condition 'not obj' (see screen shot below). This identifies around 14,000 features which can then be removed. I naively thought, as the spurious data apparently has ‘no object’ and cannot be displayed in MapInfo , FME would automatically identify these features in a similar way and somehow inform me, at which point I'd use the relevant transformer to remove them. Unfortunately in this case FME reads all the data as valid data and when I attach an inspector it displays all the features !?!Could someone please advise me on what transformer and / or parameter I need to use to stop features which are not objects to be removed?Screen shot below s

i can finish ifc to standard citygml ,but the conversion between ifc to citygml ade has some propblem ,such as " The 'lod4Geometry' citygml_lod_name trait is invalid for 'Stair' features, the geometry will be ignored, valid values are {lod4MultiSurface}." when i set the citygml_lod_name value is lod4MultiSurface,there has more error,how should i set the CityGMLGeometrySetter transformer?

HiI'm having problem connectiong to Cambridge dataset in smallworld.my FME version is 2009 and I'm using smallworld core 4.0 , also i have tested it on smallworld core 4.2 with the same error.The full log is attached.Best regards,Aramideh

I cannot get hyperlinks to work when using a dynamic excel writer using schema. This is how I hook the hyperlink up to the file_path field.Basically just creating a new attribute as suggested in the manual: file_path.hyperlinkI get no errors but there are no hyperlinks in the written excel-file.Does anyone have a workaround for this?

I would like to label all the cells in a DGN file.

Is there a way of creating a Workspace where I can have a selection list (user parameters) of Feature Type (GIS.WaterMain, GIS.CombinedMain) to read the Schema with attributes (is this dynamic of generic)?I've been able to create a Dynamic Reading but Schema is fixed to attributes in the Reader, Generic is only shows on field.

@shazad.tareen@gmail.com

Hi,I have a dgn with faces which I want to convert to fme surfaces to be able to put texture on them. FME reads these faces form dgn as polygons. I tried to convert these polygons to faces with the FaceReplacer but a lot of the polygons failed because they are not planar. If the FaceReplacer works I plan to use the GeometryCoercer to convert the faces to surfaces. Does anyone have an idea how to solve this problem?Thank you

FME 2019.0 build 19238 Desktop on Windows 10 and Server on Linux (CentOS 7)I'm trying to migrate a large dataset (tens millions records) from a Google BigQuery table into a PostgreSQL table, but the translation failed and this error was logged. Tried some times, the translation stops always with the same error.Translation FAILED with 1 error(s) and 0 warning(s) (11375000 feature(s) output)FME Session Duration: 59 minutes 9.9 seconds. (CPU: 1945.4s user, 53.5s system)END - ProcessID: 11848, peak process memory usage: 1027252 kB, current process memory usage: 843964 kBjava.lang.Exception: Google BigQuery: Error retrieving query results from job '****************:********.********' executed on table job_*_***************. Provider error: 401 Unauthorized{  "code" : 401,  "errors" : [ {    "domain" : "global",    "location" : "Authorization",    "locationType" : "header",    "message" : "Invalid Credentials",    "reason" : "authError"  } ],  "message" : "Request had invalid authentication 

I am running FME Desktop 2018.1 in a Windows 10. My source data is in a SQLServer database (2016 R2) and the destination feature class is in an ESRI Enterprise Geodatabase (ver 10.5.1) also using SQLServer (2016 R2) as the backend database.The destination feature class is in a Enterprise spatial data warehouse, business decisions are make on the contents in the destination feature class.I have a FME Workspace that reads a table with latitude and longitude and writes to a feature class in a ESRI Enterprise Geodatabase.The writer is set to TABLE Exists: 'yes', TRUNCATE Table First: 'yes' It appears that FME:1) Truncates data in the destination feature class, then 2) Reads the source table, then 3) Writes to the destination feature class. Is this correct or have I misinterpreted the FME log files? If this is correct, then there can be considerable time when the destination feature class is empty or being updated. If FME does truncate the destination data first, then can I

I have created an Excel template to be used as backup for billing expenses. The invoice has a header with specific places for billing date range(start, end), project name, project number, and project manager. The final output has a separate sheet for each project number. I have added AttributeManager to get rid of all of the other attributes and only have the 5 I need to insert into my template - the itemization is added later. I have everything working except getting the aggregated attribute value (i.e. project name) added to the named cell. How do I specify where to write each attribute?Version 2018.1 Desktop

I have a list of code numbers and descriptions. i wish top converted them into an xml file that has parent child relationship. Can any suggest tutorial or content that is appropriate? Thanks Bhere is a screen shot of my listand here is what i need