Data

I am looking to do an initial extract of a utility customer's Intergraph data to Smallworld using FME workbench. Is there a way to do an incremental extract on a nightly basis, without completely reloading the entire database?In other words, is there a way to identify daily changes in Intergraph data (ie time stamp, versions, etc) ?@MarkAtSafe

So I have a large CityGML file, which is the LoD2 model of New York City. I now would like to export all buildings into individual .obj files. Currently I am facing two challenges:The file is too large (30G) to be loaded into FME data inspector directly.I do not know how to extract individual buildings in a programmatic way.I already loaded the data file into a 3D City Database using the importer / exporter. But still confused how to solve the two technical challenges above. Any advice would be helpful. Thanks!

Hi @Mark2AtSafe, @RylanAtSafeHaving trouble authorizing FME Server (FME Server 2017.0 - Build 17259 - win64) for use with ArcGIS Online. The FMEServer instance is part of a private network, therefore I have followed examples including those at:https://knowledge.safe.com/questions/43567/arcgis-online-oauth-authorize-issue-on-fme-server.htmlhttps://knowledge.safe.com/questions/65076/connecting-to-arcgis-online-via-fme-server.htmlhttps://knowledge.safe.com/articles/40215/configuring-fme-server-to-use-oauth-based-web-conn.html I have done the following:The FMEServer has been enabled for HTTPSThe service account under which FMEServer runs on the server has necessary proxy whitelisting to hit the AGOL domainsSince the FMEServer is private, it is not accessible publicly, nor has a public DNS entry. So as per the example in (3) I have set up a nip.io redirect to the IP address of the 'private' FMEServerI've got a registered application in AGOL (so got a clientId, clientSecret etc).

Hi Everyone,I have a workflow that takes a submitted Excel workbook and validates all of the input. The validations are not simple and often require checking data against databases, checking against other rows/tabs in the workbook etc. At the moment, I am writing out any issues/validation failures to a text file e.g. The value: 'XYZ' supplied on Tab: 'Tab1' in Row:5 Column:'C' is invalid for reason 'ABC'. I would like to highlight Cell C5 in red on the original file and send it back. I don't want to create a new file or write all the data back out, just simply locate specific cells in the file I read in at the start and change their formatting. Is this possible? Thanks!J

So I'm simply trying to update a versioned table (happens to be non-spatial) in my ArcSDE database.  The table exists now in SDE, I just want to truncate it and replace it with a whole new set of records every so often.  Everything seems to run correctly in the log, but when I go view the table, even under my version (the one I used in the writer), all the old records are there like nothing ever happened.  It says it wrote them, where did they go?  So not only did it not truncate the table like I told it to, it didn't write the new records either.  If it matters, I've tried using both SDE writers with the same result.  Tried using the Insert vs Update parameter, same result.  Tried using the SDE default version instead of my own, same result.  This is a 10.0 SQL database, but I have 10.1 loaded on my desktop.

Hi, I have a table containing Id's and url's referring to online pdf's. For each record in the table I want to search a specific string in the associated pdf. If the string has a match in the pdf, I want to retrieve the Id from the record containing the url to the pdf. I tried using feature reader en pdf reader but didn't get far. So any help would be welcome.Idris 

Hi guys, Hope you are well. I am just trying to figure out what would be the best way of doing this and if FME has a method. I understand Arcmap can do this but may take sometime.I have a shapefile generated which has a chainage of a road with various chainage parts/distances. I then have a spreadsheet which contains 40 records which has a start chainage and end chainage. What i require is to create X & Y coordinates for the start chainage and end chainage within the chainage of the shapefile for the spreadsheet. So basically this spreadsheet will then have another column with the X and Y coordinates.What would be the best process to do this? Is there a specific transformer that can be used to create these points? Start ChainageEnd Chainage153150154340

I am creating a Dynamic Data Uploading Workspace which will read all .mdb files present inside a folder & upload Data in the corresponding tables in Orace Spatial DB. The problem is the DB user which I have, to perform this Upload operation does'nt have Truncate rights on tables since its not the Table Owner & for policy reasons it cannot be given these rights although it has Insert,Update,Delete rights. How do I Delete records from Tables before inserting new ones? Apart from creating 2 seperate workbenches, First for deleting the records using SQLExecuter & second for inserting using Dynamic writer & connecting the 2 using Batch Processing.

Hi,Using fme workbench I am writing(fan out) dwg files. Some of the filename has arabic character which fme is not able to write. following is the messageERROR |AutoCAD Writer: An error occurred for dataset 'D:\\Projects\\Filegdb_to_AutoCad\\Output-dwg\\?????? ????.dwg', in function RealDWGWriter::saveDatabaseAs: 'eFilerError'Note: fme is able to write arabic attribute as OD without any issue but the cannot create file.I am on windows 10 arabic enable OS. I can create arabic filename outside fme.Any solution or workaround.Regards

Only the Open API Geodatabase writer can be used on FME Server/Cloud, which doesn't allow you to expose the 'geodb_type' and 'geodb_metadata_string' format attributes.  Is anyone aware of a workaround for writing metadata to Geodatabase? This seems to be a major drawback of Server/Cloud if not.

Hi, I try to open an XML file downloaded with the SentinelDownloader but I get this error:  Loaded module 'SENTINEL2' from file 'C:\\Program Files\\FME\\plugins/gdal/GDAL.dll'FME API version of module 'SENTINEL2' matches current internal version (3.8 20180604)SENTINEL2 reader: Opening dataset 'C:/4-Igual que 3 pero bajando ALL/all/S2A_MSIL2A_20181103T111221_N0209_R137_T30TVK_20181103T122857.SAFE/MTD_MSIL2A.xml'SENTINEL2 reader: Cannot find =Level-2A_User_Product.General_Info.L2A_Product_InfoSENTINEL2 reader: Failed to open the dataset 'C:/4-Igual que 3 pero bajando ALL/all/S2A_MSIL2A_20181103T111221_N0209_R137_T30TVK_20181103T122857.SAFE/MTD_MSIL2A.xml'. Please ensure source data is valid and correct reader is selectedA fatal error has occurred. Check the logfile above for detailsFailed to obtain any schemas from reader 'SENTINEL2' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, depend

Hi all,I am trying to create a workspace to automatically review other workspaces to ensure they meet our development standards and guidelines. One of these standards is that all connections used should be in the master connections file we all share. Which reader do I use to read the fme_connections.data file and get a list of the connection names? A standard text reader returns a load of #$@#@!# so I assume it's encrypted somehow?Thanks in advanceJames

Is it possible to read in data into an fme workbench from a THREDDS data server via Opendap? I can see that this article (https://blog.safe.com/2014/10/netcdf-meets-gis-geospatial-architecture-scientific-data/) suggests that it is possible but a cannot find any useful resources that explains the process. Any help/direction to docs will be much appreciated.

Hi, having problems Reading a Global Mapper raster format: *.GMGThe *.gmg format is a grid format in binary formAnyone know how to read it with fme?

Hello, I am new in FME.I need to create a KML that contains a set of placemarks with every jpg geotagged photo.INPUT: Set of jpg geotaggedOUPUT: KML with photo icons that I clic and show me the photo in a window. Thanks for your answers.

I'm trying to generalize the map. I want to add building names to their geometry, but I have a problem with that. I tried to use TextAdder and Aggregator and the result is good. I then use the temporary location to be able to use ArcPy and here the problem arises. When I add TextAdder and Aggregator, I get an error:Python Exception <ExecuteError>: Failed to execute. Parameters are not valid.ERROR 000732: Input Features: Dataset pre_aggregation does not exist or is not supported When I don't use TextAdder and Aggregator everything is good.

I am generating Results with Esri file geodatabase in Network location but I am receiving following errorUnable to connect to the File Geodatabase at '\\\\server\\project\\Test.gdb'. Make sure the correct filename was specified, and that the geodatabase wasn't saved with a newer version of ArcGIS than the one installed locally. The error number from ArcObjects is: '-2147024894'. The error message from ArcObjects is: {}A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for details Please advise for further.

I would like to combine existing text to the point attribute (z-coord). In the picture there is point and line string to point to it. In the other end of the line, there is a text object. All object are separate ones. Only the each object coordinates gives the hint, which text belongs to which point. Anyway Happy New Year from Finland despite the latest ice hockey result. ;-)

Hi everyone, I'm working on a Minecraft map based on a DEM and some layers, like rivers, vegetation and underground.I'd like to get some tips about how to associate geological layers to a DEM point cloud and then export to Minecraft. I have a .tiff and some .shp files, and I'm using Bowen Island's workbench as a basis, so I think it might be associate to the custom transformer "MinecraftRasterizer". Thanks in advance! 

Hello, does anyone know how to create and write microstation dgn text with leader lines? Many thanks, Owen

Hi folks, I've had a look through the knowledge base and tried to find another reference to this, but cannot find the same problem. I have a workbench that pulls data from a couple of our postgres databases, checks it against data in an excel workbook, and, where required, appends new rows to the bottom of the excel worksheet.I'm using the excel writer in insert mode, and using overwrite set to no, having identified the location to start writing by checking the existing data and using an attribute called rownum with a counter to give the row number attribute for the rows to be written to. As this is an existing data sheet the header rows already exist, so the output field names is set to 'No'The existing excel workbook being written to contains a large amount of formatting and conditional formatting, so I have left this as existing rather than trying to apply any formatting via the excel writer or the excel styler transformer. Almost everything works fine, apart from th

Hello,I'm trying to read ArcGIS Online feature services with attachments into a local file geodatabase. I've been able to manage that, however, I noticed every time the script is run, it overwrites the edit tracking attributes. We need to be able to retain ArcGIS Online attributes intact to know who has created/edited the records in ArcGIS Online. Any suggestions on how to keep the attribute intact, so they are not overwritten during the process?Thank you for your help

How I can run two procedure after write using this option.

I've successfully written out text nodes to a DGN following the information in this article:https://knowledge.safe.com/articles/1539/writing-microstation-dgn-text-nodes-with-fme.htmlThe text nodes are displaying in the DGN and look correct, however, FME is generating warnings for each text node being written out and each feature is being logged as follows:Feature specified type fme_text, but did not have the appropriate geometry attributes for this type -- feature has been logged, and will be passed to the writer as-is+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Feature Type: `__GO_TO_FINAL_OUTPUT_ROUTER__'Attribute(32 bit integer) : `Loop to MultiTextCreator_2_MultiTextElementBuilder_2_Input1545672846 Input Splitter.BranchingFactory.Count' has value `1'Attribute(64 bit integer) : `MSLINK' has value `364787'Attribute(string) : `__wb_out_feat_type__' has value `All Levels'Attribute(encoded: UTF-8) : `fme_feature_type' has value `Level 44'Attribute(string) :

Hello, I don't see FME Server on the Azure Marketplace. Can you direct me to "how to" and/or "cookbook" resources for deploying FME Server on Azure? We will have SQL Server already deployed though not sure at this time if that SQL will be IaaS or PaaS.Thanks, Bob