Using readers and writers to extract and load data.
Recently active
Is it possible to use the SharePoint reader to connect to a SharePoint using anonymous credentials? There are a few public sharepoint websites where we would like to mine information from and all of the options in the reader are requiring authentication.Is there an anonymous syntax, option or checkbox somewhere?
I have the SnakeGrid projector so can convert coordinate systems but can't seem to carry the attributes over (I have tried AttribueManager and AttributeCopier). Also, can I input several .shp and run a batch to export as .dgn with attributes carried over? Any help would be massively appreciated.
Hello - I have a Google Sheet that is designed in such a way that some of the columns (8 total) are repeated 10 times. An example of the structure is:Time|Name|Date|Report|From Time|To Time|Activity|Location|District|Neighborhood|Activity|More?If "More" for the data entry of the form is set to "Y", the following columns are repeated for additional data entry:From TimeTo TimeActivityLocationDistrictNeighborhoodActivityMore?When the Google Sheet is added as a reader, the repeated columns have a 00 to 08 appended to them.What I need to do is, based on "More" being set to "Y" for a user (i.e., Name, Date), create N number of rows taking the values from the 00 to 08 columns to create the subsequent rows.I've played with AttributeExploder, Aggregator in my current workspace but I'm stuck! :)A push would be great from the community.Thanks in advance!
Hi all,I have installed Oracle clients 12.1 32 and 64bit on same machine and I can run my workspaces successfully (using FME 2017 32 bit or FME 2018 64bit)However for other users the Oracle formats are greyed out in your Formats Gallery. Also they are unable to run the same workspaces. They can however connect successfully to the Oracle DB using SQLDeveloper I have the following entries in PATH environment system variable:C:\\oracle\\product\\12.1.0\\client_2;C:\\oracle\\product\\12.1.0\\client_1 etc...I also have TNS_ADMIN system variable pointing to a network path Any ideas?
Good morning,I am having trouble overriding a coded domain value within a GDB. I received a GDB and I do not need the coded domain values assigned to one of the attribute values. Instead of going through each feature class and remove the coded domain option, how can I override the current coded domain values in FME? I am using the GDB API writer with Feature Operation: Insert and Table Handling: Truncate Existing. Appreciate any assistance!David
Dear all experts,I am now dealing with the project that visualizes CityGML on the Cesium web application.My input CityGMLs sometimes have a wrong orientation so that the output 3D tile have the wrong side of the wall. Is there a way to convert with double side facing or to correct the wall orientation?Thank you so much!Best regards,Joe
Hi, I have a big csv file with point data (over 300 million points and z values for a 18 year timerange) , it represent the depth of a lake but the depth measures are made in different years. Some parts are measured once in the hole time range but other parts measured more than one time. From this file I have to made different raster datasets, one of them is the “Last measured depth”. I can read the csv with a CSV reader and made the calculation (See png, “Actual_Value” show the last measured depth and “Jaar” the year where the measuring took place). But reading the csv takes a lot of time and I prefer the efficiency of the “Point Cloud XYZ reader”. With the Point Cloud XYZ reader it is possible to read this big csv real fast but I can only read one z value. My question is, is there a way to use the Point Cloud XYZ reader and do the calculation for the last measured value in the same run? Or is there another way to handle such large data files in FME?
I have made a connection local with FME 64b to SQL server.This worked for about a half year but now I get the message:Error: COM.safe.fmeserver.api.FMEServerException: User encryption is specified but can't find key to decrypt.and com.microsoft.sqlserver.jdbc.SQLServerException: The connection to the host ..., named instance ….,... failed. Error: "java.net.SocketTimeoutException: Receive timed out". Verify the server and instance names and check that no firewall is blocking UDP traffic to port 1434. For SQL Server 2005 or later, verify that the SQL Server Browser Service is running on the host. at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDriverError(SQLServerException.java:190) at com.microsoft.sqlserver.jdbc.SQLServerConnection.getInstancePort(SQLServerConnection.java:3639)According to the DBA-er nothing has changed (ports are ok and there is no firewall inbetween) and when I try to log in with SQL DEVELOPER there is no problem. So I tried different varie
In 2016.1 I use a "Esri ArcGIS Online (AGOL) Feature Service" Reader and login successfully, however when I browse the Feature Services, it does not show the externally-shared services/layers that I need. I can confirm the data is visible in AGOL and accessible via REST using Postman.Is there a possible syntax for the "Feature Service" box I could use? I tried [Feature Layer Name] and [Group Name]\\[Feature Layer Name] without success. Otherwise I guess I'll have cut-over to raw REST/JSON.
Dear All,I have big text file Like shown below as sample Name / Company 01Location : ABCTYPE : AName / Company 02Location : DEFTYPE : IndustryCategory : ProductionName / Company 03Location : DEFTYPE : IndustryCategory : ProductionManagerID : 01The expected output like shown below, Name,Location,Type,Category,ManagerIDCompany 01,ABC,ACompany 02,DEF,Industry,ProductionCompany 03,DEF,Industry,Production,01 In above in each company there are many new attributes available (around 100+)Please advise. ThanksVenu
Is there a way to specify nvarchar(max) as datatype for a field using the MSSQL_ADO writer? ntext is deprecated so I can't use it anymore.
Hi,I am trying to post and reconcile in a versioned SDE environment within FME. I have set up a workspace as described by @vincethom in his post here.I have a creator-->AttributeCreator(OBJECTID that I set to -1) --> to my SDE Writer. My SDE writer parameters are as follows:Databaseconnection Connection File: (My Version) General Parameters: Transaction Type: Versioned Edit Session Advanced Reconcile and Post: Yes Delete Child state follwing reconcile and post: NoCommit Transactions at the end of Write: Yes I get the following error:Unable to post the version '"NORTHCOW\\MyVersionto the target version 'sde.DEFAULT' because the version 'sde.DEFAULT' is protected and not public. Make the target version public or retry the translation connecting as the owner of the target version 'sde.DEFAULT'Both my version and the parent access is set to "Protected". I have no issues reconciling and posting in ESRI and my licensing is curr
I would like to take a Microstation dgn file and break it up into the individual 3D elements, by element ID. I would then like to export each model as a seperate fbx file.
I'm attempting to use the WFS reader to retrieve a capabilities document using HTTP Basic authentication. However, I suspect that FME isn't sending the Authentication header unless it's challenged with a 401 response from the server, which is a problem because the server I'm connecting to returns 200 response containing public layers for unauthenticated users and hence no challenge.Are my suspicions are correct? Is there a way to force FME to send the Authentication header without waiting to be challenged with a 401 response?Things I've tried:- Checked "Use Network Authentication", selected "Basic" authentication, and added a username and password. No private layers appear under "Feature Types".- Manually typed the name of a private layer into "Feature Types". FME says that the layer was not found in the capabilities document.- Added the username and password to the URL, e.g. https://username:password@server/wfs.
Hi,I need to merge 2 CSV files based on a number range. In the first file, I have a ZIP Code with the ZIP+4 number (2 separate attributes). In the second file I have a ZIP Code with a ZIP+4 range (Beginning +4 and Ending +4 -- 3 separate attributes). I need to merge the files based on the ZIP+4 number and create a new CSV file with all the info from the first file with an attribute from the second file appended.For instance, the first file may have ZIP Code 12345 with a ZIP+4 of 1000. The second file may have ZIP Code 12345 with a range of 0500-1500 and these should match.
Hi, I'm trying to mine edits in a GDB with only a DEFAULT version. The ArcSDE GDB reader seems set up to compare differences between parent-child versions. I want to compare edits within the DEFAULT version only. I can do this using a DBMS reader and working with the A and D tables but it would be way easier to use the native reader, however setting the baseline and transaction versions both to DEFAULT returns no features ;-(. BTW the comparison business rule is between edit dates from editor tracking fields.
Hello. I'm trying to figure out if I can rely on FME Desktop for ETL jobs that need to read from Google G-Suite user directory (for group memberships in particular). There is some group information in Google that's useful to us, but unfortunately it does not live in our Active Directory....so we would need to pull from both sources to collect the user-related data we want.
Hi, I am using FME Desktop 2017.1 and I would like to be able to write a photo in JPEG format to output into a cell in an Excel spreadsheet.Does anyone know how to do this?Thank you
I have 55 .gdb files in a single path and each .gdb file has 5 to 6 files. I have to read each file from each .gdb.file can you please suggest me solution?
I have a problem with conversion of 4 bands GeoTiff into ECW. I'm quite new to this. For me seems that ECW can hold up to 65k bands, so I think this should be possible. The bands are RED8 GREEN8 BLUE8 UINT8 - if I write only RGB it works, as well it works then I only choose UINT8 band.How could I write all the bands to ECW file ? Any clues ? I took a look at this reply: https://knowledge.safe.com/questions/66914/ecw-writer-this-format-does-not-support-writing-th.htmlBut unfortunately it didn't help.
i could do a list of layers of geodatabasae, but if are some layer empty, i don´t know to do read the name of this layer an export to writer.
A quite a few ffs files of ours will not open any longer. I only noticed this a week or two ago. Is this a common issue? And is it possible to salvage them?Here is one example:I tried och open them with several versions of FME and the latest was with 2018.1
[Using FME Server 2018]I am reading in a large volume or MicroStation files and want to limit the levels that are being read in. In a previous step I created a an Excel file of all of the unique level names in the DGN files for the user to review and give categories to. The user can then delete what they don't want and make sure the categories are correct for the rest. In the next step these categories will be assigned to each of the level names. I realize that I can just remove any feature that does not have a category assigned to it later in the process but that is not efficient. Since the DGN reader can populate the features to be read, I thought I could just read the list of level names from the newly reviewed Excel file and use that to limit which levels I read in. The difference is not minor. If I read in all of the features unfiltered, that would be over 1 million features. Filtering it first can bring it down to under 700,000 features.I was thinking something with an Excel
I have services into ArcGIS Server with the cache enabled.I use it as my basemap into applications, it is super fast, cuz it's tiled.Can I view those tiles into FME?When I try to read the service with Data Inspector, I only see the vectors, without the symbology! And it takes an eternity to read! The tiles are created from millions of vectors.I'm using the usual link from ArcGIS Server : http://MyServer/arcgis/rest/services/MyBasemap/MapServerGot an idea? Or it is impossible right now?This is my closest scale.
Hi,I am using the WFS Reader for downloading data. The reading of spatial and non spatial feature classes works. Spatial feature I can filter applying a search envelope. I am now facing the problem that the reading of the non spatial feature classes ends (successfully) after 100.000 datasets.My first question:Since I did not set the maximum number of features to be read I wonder where the limitation to 100.000 features comes from? Maybe from the server side?My second question:How can I filter out only those records that meet a certain criteria. I assume it has something to do with the XML-filterencoding?