Data

I have revised an old workbench to use the "new" db_operation variable to do add/modify/delete updates in one writer instead of setting three writers with separate modes. I wonder what was done? It looks like the updates are cached and applied in a single query. The time has dramatically reduced from 15 minutes down to 1 min 17 seconds! I am using a csv file to update a file geodatabase. The geodatabase is indexed on the key. The database is 7 GB and the main table contains 24.6 million records.I write the end of the log into an annotation to give me an easy persistent change over time:(The log shows the updates written/deleted but not the full table being updated)Features Written Summary=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-Title_Memorial 86576Title_memorial 586changeset 87162====================================================================Total Features Written 174324=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

Hi All,I am trying to extract data out of Smallworld 5 using FME Desktop (smallworld edition). The idea eventually is that i can extract and full and deltas from the EO VMDS. The problem i am experiencing, is that it is crazy slow to extract - in fact, i can't extract at all.In the console window, i am seeing the following error: Join dd_join(unset) will be processed slowly for the following reason:Not 'fast' Could this be the reason of the slow extraction? if so, i have no idea what this means. Regards,Steve   

I have a workspace that reads an Excel file pulling data from a specific worksheet and a specific cell-named-range. The read is implemented as a FeatureReader (Excel) but the problem I am experiencing is the same for both a FeatureReader (excel) and a Native Excel Reader,I am passing the name of the Excel file via a Published Parameter. I eventually want to process multiple Excel files that share a common data template. My issue is that when a NEW Excel file name is passed to the FeatureReader, the cell-named-range configuration is getting dropped and I am seeing the following warning in the logs:2019-02-04 10:08:43|   0.7|  0.0|WARN  |Excel Reader: Found named range '_xlnm__FilterDatabase' on sheet '7 day speed and Vol Summary'. This is a Microsoft Excel internal name so FME will not show it as a sheet. If you wish to read this named range, please rename it    My preference would be to have the Excel cell-named-range configurable as a reader parameters but currently you can only set i

It is known that FME can read from SharePoint. But my requirement is to read data from SharePoint portal (with workflows) and migrate to Documentum SharePoint is frontend for the customer storing the content and after migration Documetnum D2 will be used as frontend.I am looking at any FME based solution by way of APIs, customization etc. TxSRG  

We want to send and receive email with FME Server, and our IT say that we're moving away from smtp / imap so, medium term, we can't use either, only Exchange Web Services (because our corp mail implementation is going cloudy).Does FME Server understand EWS?

Hi, A simple question -> I want to write "" value in a field in a csv file using csv writer.When this csv file is opened in notepad, the value should look at "" and not as """""".E.g. Note the third column, that is how it should be visible.ID,Name,Comment12,Vijay,""13,Sambhe,"" Its odd but that is the requirement. I can add a workspacerunner, read csv as texfile and replace """""" as "" and write to a textfile but I want this to be done in a single workspace. Thanks,Vijay   

Hi, I have building floor plan with floor number (which is like G, M1, M2, M3, F1, ...F19 etc.) and I have height of each floor (like 3.4, 4, 4.5 etc.). We want to show the elevated floors in GIS with as per the exact height from ground (which is height of G+M1+M2+M3+F1+F2 and so on). I have attached a sample file. We have more 10000 buildings and each building has multiple floor so manual calculation of floor elevation is tedious work.

I am having issues using the ArcGIS Portal Feature Service reader. The reader accepts the host name and my username and password and it is able to successfully load all of the feature services. After I select a feature service, I click the ellipses button next to "Layer List" and it gives me the following error:   Has anyone else experienced this error message?

Hello everybody. I added texture images to building walls in sketchup, and then I tried to transform .skp file to CityGML using FME. Transformation went successful, HOWEVER, FME doesn't save pictures the way I set them to fit the wall, it just saves the original picture as if I didn't do all the work with fitting and rotating the picture. Can anybody help me? Thank you!

Hello,Is there a way to force fme to delete all the temporary/working files at the end of each translation?I'm working with huge las files and it is taking a lot of memory so that I have to manually erase such files before doing the next translation. Thanks 

I am writing Data with the Excel Writer to a Excel Template.In this template I have defined Named Ranges. These ranges only consist of 1 Cell (e.g. PrjNr =Schachtblatt!$G$5)The Problem is that FME writes to the Cell G6 (one cell below my named range)Has anybody a solution for this Problem ?Thanks Hans

Hello everybody,please, I try to solve one huge problem related to DWG writer. I wanna add a new attribute to block definition (e.g. attribute CODE), whose structure is not synchronized to its graphic. E.g. I have one block and its graphic is inserted to model space (pic below called "old") in DWG. But, meanwhile, spectre of its attributes was spread to nowaday structure (pic below called "new"). Anyway, the graphic is not synchronized, so newly added attributes are invisible.In FME, I need to add one new attribute to block definition and export graphic of block in the same graphic as on pic "old". But, if I have to export to DWG, I still need to define TEMPLATE FILE - this is problematic thing, because DWG writer automatically will load specific block definition will all attributes, so graphic is actual.Please, has anybody any advice, how to add new attribute to block definition with keeping old graphic of block before synchronization?Thank You so much!Lu

I am reading feature classes contained in feature datasets from a FGDB and then write all feature classes to a SDE/GDB. My question is how I can avoid feature dataset names and only write feature classes. I don't need the feature dataset names  

Hello everybody! Can anybody explain to me how to convert collada to citygml using FME? Thank you!

I have migrated data from SQL spatial server to File GDB, I have given the correct primary key and used vertex function to create the points from lat-long values. Migration was done successfully but I couldn't find any spatial data in File GDB.

Hello,I was wondering how easy it would be to accumulate x number of records (for this example 500), then run a bulk roads & highways or geocode query that would send all 500 records at once to be located/geocoded in a single query instead of making 500 separate calls to the service. Does anyone have any workflows like this? I feel like something like this would be extremely good for the geocoder transformer among others. Thanks in advance!

I am using the HTML-FeatureWriter for creating a HTML-File. The HTML-file consists of different parts, stored and passed by attributes. The different script parts contain values like @Value(name). Now I want to store the script parts as .txt (or others) outside of FME for better editing. When I'm importing them and link them to attributes, it seems like the "@Value()"-tags aren't recognized by FME. Is there another way for editing scripts containing @Value()-tags outside of FME?  

I wish to add a blank line for every 'x' line in an Excel spreadsheet createt in the FeatureWriter.  Any help or guide on how to do this?   Thank you!

Hi all, I have a question concerning the output format of a tool on FME Server. Tool runs fine: input contans a DEM-layer, output contains a ZIP-folder including a .dwg-file. There is only one problem: I manually have to add the extension .dwg at the end of the file name, in order to open the file as a .dwg. Right now, the output file has no extension given after extracting the ZIP-folder. After adding .dwg to the file name, the file is correct.Anyone having a suggestion?

Hi,I have 10 building and 10 JPEG files, each JPEG is specific to the buildings .Physical path of the JPEG is configured in the attribute called "path". I need to apply textures based on the attribute "path" .  How can I achieve this? Regards,K.Jayakumar

Hello,I periodically load the latest version of topographic data (shape format) from many municipalities in our GIS system. The data is loaded per topographic object (for example: a workbench for buildings, an other workbench for roads, ...). Each workbench loads the data for all municipalities together. The first time the data was loaded the source contained 94 shape files (94 municipalities). The second time this was 92 (9 old deleted and 7 new added). I have adjusted the change in the data manually (update features and connect the new ones), a work that does take some time. Should the number of municipalities change again next time, the reader must be updated again. Is there a possibility to automatically read all shape files (which can change in number and file name) in one and the same folder, without the need to make manual adjustments?  Thanks!Luc

What I'm trying to achieve is to write data to hosted feature layer on ArcGIS Portal.In Esri ArcGIS Portal Feature Service writer parameters I'm using this template: "Host" - https://myarcgisportal.com/arcgiswebadaptor/, and tried all options and accounts in "authentication type" - "Generate token", NTLM, Kerberos and both domain and ArcGIS accounts (ArcGIS Portal admin), it shows "the server at https://myarcgisportal.com/arcgiswebadaptor/ does not appear to be an ArcGIS Portal Instance". Portal is federated with server and ArcGIS Data Store is configured. Maybe something is misconfigured on Portal?Any ideas would be much appreciated.Thanks!

I have a large number of dto's created within Mercator which I can not read through the MCF Reader. I get the following error message Error - Invalid data in file 'dto_test_notworking_t.dto'Closing input file 'dto_test_notworking_t.dto'MCF_READER_PIPELINE::f_1(SortFactory): Done sorting 0 feature(s)Error - No bounding box coming out of the pipelineA fatal error has occurred. Check the logfile above for detailsFailed to specify the feature index as constraints on the reader I also have a dto file that will read through the MCF Reader. I have tried to compare the structure of both files but the file produced in mercator seems significantly different to the one that will read through the Mercator MCF Reader. Does anyone have experience with this data type and can identify what is wrong with my data ? Sample attached. Thanks Ciara 

ArcGIS Online Feature Service Writer: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was '("Connection broken: ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None)", ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None))'

Is it possible to download a PDF file and then write that data to an MS SQL table? Any help would be greatly appreciated!I am able to download, using the below. However I am not able to write to SQL as VARBINARY(MAX).Almost there....