Using readers and writers to extract and load data.
Recently active
Is there a way to specify nvarchar(max) as datatype for a field using the MSSQL_ADO writer? ntext is deprecated so I can't use it anymore.
Hi,I am trying to post and reconcile in a versioned SDE environment within FME. I have set up a workspace as described by @vincethom in his post here.I have a creator-->AttributeCreator(OBJECTID that I set to -1) --> to my SDE Writer. My SDE writer parameters are as follows:Databaseconnection Connection File: (My Version) General Parameters: Transaction Type: Versioned Edit Session Advanced Reconcile and Post: Yes Delete Child state follwing reconcile and post: NoCommit Transactions at the end of Write: Yes I get the following error:Unable to post the version '"NORTHCOW\\MyVersionto the target version 'sde.DEFAULT' because the version 'sde.DEFAULT' is protected and not public. Make the target version public or retry the translation connecting as the owner of the target version 'sde.DEFAULT'Both my version and the parent access is set to "Protected". I have no issues reconciling and posting in ESRI and my licensing is curr
I would like to take a Microstation dgn file and break it up into the individual 3D elements, by element ID. I would then like to export each model as a seperate fbx file.
I'm attempting to use the WFS reader to retrieve a capabilities document using HTTP Basic authentication. However, I suspect that FME isn't sending the Authentication header unless it's challenged with a 401 response from the server, which is a problem because the server I'm connecting to returns 200 response containing public layers for unauthenticated users and hence no challenge.Are my suspicions are correct? Is there a way to force FME to send the Authentication header without waiting to be challenged with a 401 response?Things I've tried:- Checked "Use Network Authentication", selected "Basic" authentication, and added a username and password. No private layers appear under "Feature Types".- Manually typed the name of a private layer into "Feature Types". FME says that the layer was not found in the capabilities document.- Added the username and password to the URL, e.g. https://username:password@server/wfs.
Hi,I need to merge 2 CSV files based on a number range. In the first file, I have a ZIP Code with the ZIP+4 number (2 separate attributes). In the second file I have a ZIP Code with a ZIP+4 range (Beginning +4 and Ending +4 -- 3 separate attributes). I need to merge the files based on the ZIP+4 number and create a new CSV file with all the info from the first file with an attribute from the second file appended.For instance, the first file may have ZIP Code 12345 with a ZIP+4 of 1000. The second file may have ZIP Code 12345 with a range of 0500-1500 and these should match.
Hi, I'm trying to mine edits in a GDB with only a DEFAULT version. The ArcSDE GDB reader seems set up to compare differences between parent-child versions. I want to compare edits within the DEFAULT version only. I can do this using a DBMS reader and working with the A and D tables but it would be way easier to use the native reader, however setting the baseline and transaction versions both to DEFAULT returns no features ;-(. BTW the comparison business rule is between edit dates from editor tracking fields.
Hello. I'm trying to figure out if I can rely on FME Desktop for ETL jobs that need to read from Google G-Suite user directory (for group memberships in particular). There is some group information in Google that's useful to us, but unfortunately it does not live in our Active Directory....so we would need to pull from both sources to collect the user-related data we want.
Hi, I am using FME Desktop 2017.1 and I would like to be able to write a photo in JPEG format to output into a cell in an Excel spreadsheet.Does anyone know how to do this?Thank you
I have 55 .gdb files in a single path and each .gdb file has 5 to 6 files. I have to read each file from each .gdb.file can you please suggest me solution?
I have a problem with conversion of 4 bands GeoTiff into ECW. I'm quite new to this. For me seems that ECW can hold up to 65k bands, so I think this should be possible. The bands are RED8 GREEN8 BLUE8 UINT8 - if I write only RGB it works, as well it works then I only choose UINT8 band.How could I write all the bands to ECW file ? Any clues ? I took a look at this reply: https://knowledge.safe.com/questions/66914/ecw-writer-this-format-does-not-support-writing-th.htmlBut unfortunately it didn't help.
i could do a list of layers of geodatabasae, but if are some layer empty, i don´t know to do read the name of this layer an export to writer.
A quite a few ffs files of ours will not open any longer. I only noticed this a week or two ago. Is this a common issue? And is it possible to salvage them?Here is one example:I tried och open them with several versions of FME and the latest was with 2018.1
[Using FME Server 2018]I am reading in a large volume or MicroStation files and want to limit the levels that are being read in. In a previous step I created a an Excel file of all of the unique level names in the DGN files for the user to review and give categories to. The user can then delete what they don't want and make sure the categories are correct for the rest. In the next step these categories will be assigned to each of the level names. I realize that I can just remove any feature that does not have a category assigned to it later in the process but that is not efficient. Since the DGN reader can populate the features to be read, I thought I could just read the list of level names from the newly reviewed Excel file and use that to limit which levels I read in. The difference is not minor. If I read in all of the features unfiltered, that would be over 1 million features. Filtering it first can bring it down to under 700,000 features.I was thinking something with an Excel
I have services into ArcGIS Server with the cache enabled.I use it as my basemap into applications, it is super fast, cuz it's tiled.Can I view those tiles into FME?When I try to read the service with Data Inspector, I only see the vectors, without the symbology! And it takes an eternity to read! The tiles are created from millions of vectors.I'm using the usual link from ArcGIS Server : http://MyServer/arcgis/rest/services/MyBasemap/MapServerGot an idea? Or it is impossible right now?This is my closest scale.
Hi,I am using the WFS Reader for downloading data. The reading of spatial and non spatial feature classes works. Spatial feature I can filter applying a search envelope. I am now facing the problem that the reading of the non spatial feature classes ends (successfully) after 100.000 datasets.My first question:Since I did not set the maximum number of features to be read I wonder where the limitation to 100.000 features comes from? Maybe from the server side?My second question:How can I filter out only those records that meet a certain criteria. I assume it has something to do with the XML-filterencoding?
Hello!We have noticed that FME 2018 seems to using locks more often than we previously experienced. Is this expected? or is it an issue on our side? It seems to occur mainly on desktop.
I have converted a textured Collada model into .kmz-format in FME (still using v 2016.1 due to IT-related questions). I have converted several buildings and I can see them all when opening the resulting .kmz-file in FME Data inspector and Google earth. However, when opening the file in Sketchup and another visualization software we are using it only reads one model from the file. Anyone bumped into this problem before?
How can i transform Bently .dgn BIM model to multipatch.GDB File ?
I have ArcGIS online Point Layer, each point location 10m by 10m image with point symbol need to be export in word document.ThanksVenu
I have a user that has a KML file that has utilities added on top of Google Earth. We need to pull out some of the data and translate it to either DGN or DXF. I created a workspace using the KML file to a DGN. It said it translated 2355 features but there was nothing in the DGN file. any help would be greatly appreciated.
I have a 3D DGN file comprising of a building model, I wanted to convert it to ESRI Geodatabase without any geometry and attribute loss. I used "GeometryFilter" transformer however only lines and polygons are created without attribute information lost. Can multipatch geometry be created?? Is there a direct workflow available to achieve 100% conversion from DGN file to Geodatabase?? Please help me with the workflow. I can share a sample file if you can look into it.
Hello FME community!I am currently working on updating the metadata of a feature class using the XMLUpdater. Everything is going great so far but I am running into a little bit of a wall here. I am trying to update the Horizontal / Vertical positional accuracy in the metadata sheet. Theses can be found in Resource/Quality/Report section of the sheet. Here is a picture with the fields in question: As you can see on this example its pretty simple. You set the Dimension and fill the Horizontal Positional Accuracy report in the Description. My problem arises because I currently need two reports, one for Horizontal and one for Vertical and once I create them the XML reads as follow:As you can see both XML Path for the XMLUpdater are the same with the exception of the "dimension". That means that the XML Path for both horizontal and vertical Description read as "/metadata/dqInfo/report/measDesc".My question is: Is there a way to differentiate between these two locations i
Hello to the lovely FME communityI am fairly new to the FME world and am currently working in a small project to update the metadata of a feature class using the XMLUpdater. The process is working fine except for when I am trying to update the XML values of a drop down menu. For example If you go to the Item Description of the feature class and go to "Overview" --> "Citation Contacts" I am trying to change the "Role" from Distributor to Publisher like this:After some trial and error I found that the XML tag for this particular field is: As you can see "value = 011" is inside the tag and I tried different options within the XMLUpdater but it seems you are only able to replace whats after or before the tag(RoleCd value="011"), not what is inside (in need to change the number 011 to 010). I think It is not something I can replace using XMLUpdater (at least to my knowledge) so I was wondering If somebody could provide some feedback and p
Hello,I am trying to convert IFC to 2D Shapefiles. What I really want is to get the 2D Exterior boundary of every model. Sometimes it is the footprint, but sometimes is the footprint + the exceeding slabs or a buildingelementproxy. My method is to use a 2DForcer and then a GeometryFilter to extract the Areas in order to write Polygon Shapefiles. However, in models with high complexity the 2DForcer creates many small polygons as attached in the photo, that kill performance. This is partially solved using the Dissolver, but in cases as shown in the photo the process can take 2hours or even more in a PC with acceptable specs (i7, 32GB RAM).I would welcome any ideas on how to make this process more efficient. I have tried the TriangulatedSurfaces but with no luck. I believe it is normal, since IFC's geometries are solids. Should I create composite surfaces and then work with them? But this sounds like too much trouble to just get the footprints of a model. The BoundsExtractor also did
Hello!I have a ifc file(,the model is white color) and I have to export them to gltf to visualize them on Cesium.With FME I can export them to gltf, but when i visualize them on Cesium,it is rendered black color. I found the gltf file lost some things such as "NORMAL" in "attributes",and so on.I don't know whty, can you give some advise? thank you