Data

Hello, I have a bit of a problem that I can't find a solution to. I have a list of directories and sub directories. Some contain shapefiles. Some contain tables, gdbs etc. Eg: S:\\NEW\\170530\\test.shpS:\\NEW\\170529\\NewData\\NewTest.shpS:\\OLD\\170428\\test.xlsxS:\\OLD\\170428\\MoreData\\MoreTest.shpThere are more folders within those dated directories. The root drive is always the same "S:\\"The root data directories (eg, OLD, NEW) will be provided by users as a user parameter. There won't be any navigating to those specific directories. How can I have a workbench that reads all the shapefiles nested in all those different directories, once the root data directory has been passed to it? Everything from the PATH reader up to the FeatureReader only specifies up to the dated directory based on user input. Eg:S:\\NEW\\170530I saved the directory path and passing the following to the FeatureReader: S:\\NEW\\170530\\**Now it works.. but with a couple of drawbacks. For on

Hi I am trying to use FME to update data on AGOL. This works with small data sets, however on larger datasets I get a timeout error (see below), when the process takes more than about 20 seconds.I am using FME 2015.1.1.0 and can't upgrade at the moment :-(I have tried using system proxy settings (but this did not make any difference)If I process the updates in batches this works (but is messy), and I can't truncate a large tables (as this is one large transaction)Has anyone else had a similar issue with a known work around? FME Error: "The error was 'HTTPSConnectionPool(host='services2.arcgis.com', port=443): Read timed out"

I have set up my Geodatabase Writer but can’t write to it. The log file gives me this message: “Geodatabase Error (-2147024894): The system cannot find the file specified.” even though I’m creating a new file geodatabase within my workflow.

Hi,I have a simple workspace. I read a file (interlis2) and have 4 parallel transformers attached (GeometryReplacers, followed by GeometryFilter and AttributeRenamer).When I run the workspace it crashes at exactly the same data row in my input file without any further error message except "fme has stopped working". Nothing in log file either.If I disable two of the four parallel transformers and run the workspace and afterwards disable them and enable the two remaing ones all data is read and written (Autodesk sdf3).Memory is no issue - FME just uses 500 MB, there is plenty left.Any ideas why that happens? I would like to run the workspace in one go.Thank you, Rob

Hi.I have the following .json file:{    "0": {        "0": {            "Group 1": {                "Sub 1": 0,                 "Sub 2": 70            },             "Group 2": {                "Sub 3": 0,                 "Sub 4": 29            },             "Group 3": {                "Sub 5": 136,                 "Sub 6": 120            }        },         "1": {            "Group 1": {                "Sub 1": 0,                 "Sub 2": 76            },             "Group 2": {                "Sub 3": 1,                 "Sub 4": 35            },             "Group 3": {                "Sub 5": 157,                 "Sub 6": 115            }        } },"1": {        "0": {            "Group 1": {                "Sub 1": 5,                 "Sub 2": 72            },             "Group 2": {                "Sub 3": 51,                 "Sub 4": 2            },             "Group 3": {                "Sub 5": 16,                 "Sub 6": 20            }        },         "1": {           

Hi I created a workspace to evaluate if a point is inside a polygon, the workspace looks:The first input is an Esri ArcGIS Server Feature Service I'm loading the polygons from a Feature service, the second input is a csv file with a list of points. The workspace is working as expected, PointOnAreaOverlayer is detecting is the points are inside any polygon.Now, my goal is to sent the points from another application to the workflow (can be to a rest endpoint) and call another rest endpoint if the point is inside any polygon, additionally, I want to keep in memory the polygon list (loaded from an external arcgis feature service) and refresh the geofences list periodically (The geofences changes time to time).[More information]Basically we need:A way to send features from an external application, We have an AVL application that receive vehicle data we can forward each message receive by vehicles to FME (about 500 messages per second)We need to evaluate for every single message if the v

Hi All,I have noticed that when creating a large number of ffs files (with spatial index option on) just one fsi (index file) is created for all the ffs files. This is done via a ffs writer in a workspace.When using the ffs files is a spatial intersection, FME warns:Unable to apply native search envelope for file 'C:\\mmm_1.ffs' due to missing index file 'C:\\mmm_1.fsiSo can somebody explain to me: if this is a warning does FME actually uses the spatial index ? or is it not used and therefore a bug? should actually a index file per ffs file be created? (only seen that happens if the ffs is re-read and saved again)Cheers,Itay

@DeanAtSafeI saw your article on using KMLTourBuilder linked below. It is very helpful however I'm getting stuck creating my tour. I would like my tour to orbit over a single point. I have created a buffer around my subject point and set my tour to follow the buffer circle. This seems to work but I need to adjust my heading as I work my way around the circle. Ideally this would be a heading adjustment of thoroughly 7 roughly 51 times (360 degrees) so my camera view (heading) is always facing the middle of the circle. http://fmepedia.safe.com/articles/Samples_and_Demos/Climbing-Sydney-Harbour-Bridge-with-FME

Hi,  I cann't use the Adobe Geospatial PDF writer to output Chinese or Japanese text.  I have tried modify my font file's name and it's name show in FME's font window to non-Chinese; also flow the help's instruction to modify the fme_text_string to rich format, like "你好", and set the parameter of Writer "Text in Rich Text Format" to yes. But both failed.  If you can output some special non-English characters to PDF?  Thanks

Hi There, I recently upgraded my workspace from version 2015 64 bit to 2016 64 bit. This workspace generates a shapefile as an output. I noticed that there are differences in records count in these shapefiles. I want to know the difference between the two file shapefiles to see what changed. I was hoping that ChangeDetector transformer might do this but it show all the records as changed, curious if there is a better transformer suited for this. Thanks Jay

When I write a polygon geometry whose western edge is equivalent to -180.0, but in Spherical Mercator (-20037508.342789244), the longitude value switches signs and becomes positive. I have tried the same process, but writing to a GeoJSON file and no problem occurs.Is there any value modification occurring when features are written to the Spatialite format?I can provide a very simple workspace to replicate this if it is needed.For what it's worth, I believe this is a precision problem. Simply changing the western longitude from -20037508.342789244 to -20037508.34278924 "solves" the problem. It does however translate to changing the actually geometry because something that originally was equivalent to -180.0 is now -179.99999999999997.

How can I convert .shp to .csv and include Postal code as well as lat/long? I am able to make the conversion, but only Postal code is exposed in the .csvThe original shape file has x and y axis and is using EPSG 102015, the .csv would preferably convert to EPSG 4326 and include lat/long

Does anyone know if FME can write / read / interact with MongoDB?   

Hi All, I have 3D building model in *.shp format with LOD2. I have to apply the textures and covert that model into citygml format with attribute information. Please if any have the template share with me as well idea or suggestions also......

Hi,What is the simplest way of to create an ongoing process that will import all "recently modified" records. "recent" means all rows in source where modified date > latest "Modified date" in destination.I have millions of rows in about 10 tables.Each row has a unique ID which can be used to overwrite the destination.I am planning to copy all fields and all rows (replica).Source database: MS SQL 2008B, Destination database: MongoDB.Thank you,

Hello,I implemented a changed detection on oracle table.Now I would like to be able to create a json for each change per object. For instance, for an object where changes were detected on 5 attributs, below will be the json that I would like to obtain:{ "ATTRIBUT1": { "OLD_VALUE": "OLD1", "NEW_VALUE": "NEW1" }, "ATTRIBUT2": { "OLD_VALUE": "OLD2", "NEW_VALUE": "NEW2" }, "ATTRIBUT3": { "OLD_VALUE": "OLD3", "NEW_VALUE": "NEW3" }, "ATTRIBUT4": { "OLD_VALUE": "OLD4", "NEW_VALUE": "NEW4" }, "ATTRIBUT5": { "OLD_VALUE": "OLD5", "NEW_VALUE": "NEW5" }}How can I proceed to obtain this in fme?I was tinking of the agregator to group all the changes from the same object (based on an objectid) and then build the json but I don't know how to proceed.Please keep in mind that the number  and names of attributes will change from one object to another one.Thanks,

i have to convert CityGML to IFC ! an i get no gemetry at the end ! Why ?

Dear FME-users,  I’m creating feature classes (polygons) from NetCDF-data. Among other things I use the transformer “RasterCellCoercer”, the transformation needs so much time.  I’ve 504 input and 504 output files. The geometry is always the same, just the values of the input data are different.  Do you’ve an idea how to reduce the processing time? Maybe a predefined grid?  Thank you so much and best regards.  Konrad

I have an issue currently with lidar data and a project to calculate flood areas. The Lidar data which we have received contains reflections on the water surface (specular reflections) which cause the water surface to have elevations where there are nearby trees and vegetation. In order to create a flood senario, we will therefore not be able to use the water surfaces in the lidar data. How then will we be able to create flooding estimates in the water surface height is not reliable?

i want to import and export IFC and CItygml Data via Data interoperabilty in arcscene but i get always an ERROR, EMPTY GEOMETRY

I have to determine the direction of a closed curve (a line where start and endpoint are the same) because I want to derive a gpx in the right direction (clockwise) from the polyline. Is there a way to do this? So I want to test if the polyline has a clockwise direction and, if not, reverse the direction. I tried the Polylineanalyzer and the azimuthcalculator, but both don't give me a solution.

Hi,  I am passing records from Postgis to Smallwrold. But when it takes half an hour working template I get this error.Know the cause?   How long should the Smallworld server offline the workbench  to make it happen?  Thank You