Using readers and writers to extract and load data.
Recently active
Hello, i try to create dynamic Excel data i a german environment and have a problem with the datatype.As you see fme detects the same value as utf-8 and 64 bit real. Real values generate correct output in excel as number but utf is put out as string with dot as decimal limitter.Is there any way to force the datatype to real?Hendrik
Hi allFME Information Edition: FME Database Edition Version: FME(R) 2017.0.0.1 (20170316 - Build 17271 - WIN64) I have a 3D buildings dataset in different formats .shp and .dgn. Buildings are built from individual shapes (walls, roof parts etc.) Normals are not consistent, some being LHR (left hand rule) and some RHR (right hand rule). Based on manual check I know which normals are LHR and which are RHR in a sample data (attached ).I also have a version of data in .sqlite format where all normals are RHR.I need to identify direction of each normal with FME, but OrientationExtractor doesn't provide consistent and correct results, comparing to the results of manual check. FME recognizes some LHR as RHR and opposite, fx, indicating that some of the shapes in .sqlite data are LHR.I also tried using Orienter to ensure that all Shapes are oriented one way, and then using Orientation Extractor again, but it provides wrong results again. Data -> OrientationExtractor (LHR, RHR) ->
Hi, I am getting a fatal error while translating a DGN file to DWG format.Object Data Writer: Failed to create object data table named 'XXX' in datasetA fatal error has occurred. Check the logfile above for detailsKindly help me to translate a DGN file to DWG along with symbology like Colors, line styles, Cells (in DGN) = block (In CAD).Thanks in advance.
Hi,I have a MapInfo file which I am trying to convert to an ESRI Shapefile. I can open the file using the MAPINFO reader in FME Data Inspector but when using the same reader in FME this returns the below error: Failed to open native MapInfo file 'Biological_Heritage_Sites_Distribution_2012.tab' could not be opened as a MapInfo dataset.<br>I have tried using both the 32-bit and 64-bit versions of FME but receive the same error in both. The TAB file has all file elements within the same folder (.TAB, .ID, .DBF, .MAP) I have also tried both the TAB and MITAB readers. Is there anything else you can advise to try? Thanks in advance for your help with this.Thanks, Charlie
I am trying to set a published workspace parameter(s) to automate an ETL routine that reads multiple tables from one PostGIS DB to incrementally update another single table in a separate PostGIS database. The simple workflow is something like this: a) Multiple tables from a PostGIS database are read and concatenated in another separate PostGIS database table representing a single canonical theme of these records. These themes classify certain field collection survey records into a meaningful, single common theme. b) The second database does have a function which writes the id, feature_type and a run_date to an etl_log table each time the routine processes. I'd like to use this automated output as an input value each time an update routine is called on the server. I've tried to work in a SQL SELECT statement that filters only those records that have a created_at or updated_at attribute greater than (or after) the run_date and label those as "good", passing through to t
Hi,I have a IFC file that I want to use for a transformation. It has correct latitude and longitude values, but missing elevation values. I wanted to update the elevation value by using the AttributeValueMapper on the IFCSite class and giving it a fixed value for the RefElevation attribute. But strangely, after the transformation, not only the value for RefElevation is missing, but the values for latitude and longitude are gone, too. What am I doing wrong? I would be grateful for any help you are able to provide.
Hi, I tranform some rasters from a certain source format into GeoTIFF files with a jpeg compression (75). But by doing this, the background values are not anymore 0,0,0. Resulting in a series of (almost) black pixels at the border of the image. When writing to a GeoTIFF without any compression the 0,0,0 value of the complete border area is maintained and the background can be made transparant. Is there a way to use the compression and to keep the complete border area black (0,0,0)? Secondly, why is it not possible to use jpeg compression and the BigTIFF option at the same time in the writer? thx
Good morning!Today my FME Desktop 2017.0 has given me the following error while running a Workspace:It doesn't start at all. Not even the log is written.This is a workflow to update several metadata XML files. For the ID of those metadata I have used "fme_(type_of_metadata)". For the ATOM service and the Dataset metadata is working fine, but with the view service metadata always gives me the error from the pic.If I change the metadata ID to something else, the workspace runs without issue. So it seems I have hit some restricted words for the "metadat_id" variable value.Is there any place in the documentation where I could check which words we are forbidden to use?Thanks!
Hi, I've literally just started experimenting with FME. When I run, it says that the translation was successful. But it doesn't seem to create output. I get a "The source file isn't valid" error when I open the inspector, and when I browse to the folder there's no output file. I'm trying to convert a DGN to Esri shapefile, and I've literally just been following the steps on an online tutorial, and I've used their datafile, and my own. With both input files, I get the same error. Do I have to change something in my general FME settings, or are the settings on my PC the issue?
Hi,I am after a method to define the vertical co-ordinate system of features being output, particularly after using the 3DForcer or Vertex Creator.The data coming in doesn't already have the height datum defined, particularly as it is often from CSVs. Thanks-Jack
Hello folks,Simply, what I am trying to do with my script, is create a service that allows the person running my process on FME Server to add a Plan ID # to the start of a file deliverable name. Example:Current output file name: Complete_Data_DWG.dwgPublished Parameter "PLAN_ID" value: 24883Desired output file name: 24883_Complete_Data_DWG.dwgI have already tried using "$(PLAN_ID)_Complete_Data_DWG.dwg" but it only returns that exact string (with $(PLAN_ID) and not the user set value).Basically my script works and I am just trying to make it more aesthetically pleasing and to also provide better file management for my clients.Thank you for your time,Moe
Hi,I am trying to create one CityGML file based on two others. Both have the same CRS. I am not sure if I have to use transformers and if yes which ones? It did not work with only two readers and one writer. Maybe there is a solution by using XML-Transformers and the "CityObjectMember". It sounds like an easy task but I am new to FME. By the way, I am using FME Desktop 2017.1 Thanks, The Cartographer ;-)
I am new to using FME cloud, can you please explain how I can install custom python libraries onto FME Cloud and call them before the workbench runs. I would like to drop and create an elasticsearch index before the workbench then goes and populates it.Many Thanks,OliverThe current python code is:import pyodbc, jsonfrom elasticsearch import Elasticsearches = Elasticsearch([{'host': 'search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com', 'port': 443}],use_ssl=True,verify_certs=False)es.indices.delete(index='productdownloadsdb_full', ignore=[400, 404])mapping = '''{ "mappings": { "downloads": { "properties": { "HYPERLINK_PDF": { "type": "text" }, "HYPERLINK_ZIP": { "type": "text" }, "ID": { "type": "integer" }, "PDF_BODY": { "type": "text" }, "PDF_FILE": { "type": "text" }, "Title": {
Hello everyone, We are doing a prototype where the geometries from Oracle spatial are imported to GE smallworld and are adjusted to new locations. The old and new locations are maintained in a CSV file and the source Oracle data is to be modified based on this CSV file using FME. Each and every coordinate in the Oracle spatial data will have it's original geometry and the adjusted geometry in the CSV file. I wanted to know if I can use FME to update all the oracle spatial coordinates with the new coordinates from CSV file. If I can, how to achieve this. Appreciate any pointers and help in this. Thanks, Kalyan
I have a workspace that uses the GeoRSS reader that spatializes a newsfeed and writes to an SDE feature class. The newsfeed carries 25 items per day and a handful of news stories are posted each day. How do I configure the parameters in the writer to retain all of the old items and "append" only the new items, so as to preserve all items and build a running total?
Hi,How can i store _packed attributes which is having multiple attributes packed by AttributejSonPacker?Can i store that _packed attribute as BLOB type attribute in File Geodatabase?Thanks in advance.
I want to create a new autocad layer (aka fme_feature_type) and add it to an existing drawing with a specific layer color property. Any ideas?
I am using Update write to do updates to a version in esri geodatabase and wonder how to I tell the writer to only update attributes and not geometry. Has anyone done something similar? Thanks!
This question is very similar to "ArcGIS Server Feature Service Reader Token Authentication Issues" found here: https://knowledge.safe.com/questions/29547/arcgis-server-feature-service-reader-token-authent.html. I'm trying to automate feature extraction from a secured ArcGIS Server feature service. I have a username and password, but when I try only using those credentials in the reader, it tells me I need a token. I can generate a token manually through the REST service page using my credentials, and it works in the FME job I have, but I'm not sure how to automate the process now. I'm using the token workspace provided by @todd_davis in the thread referenced above, and the token is getting generated correctly since I can view it in the inspector, plug it into the other workspace I'm trying to automate, and it runs fine. The problem is, I can't figure out how to pass it to a feature reader or other FME workspace that will authenticate and allow the wo
I am using FME trail version and cannot plugin CityGrid (Plugin). Where do I find this plugin as I want to view CityGrid Data on FME
Hi all,I guess I cannot to see the wood for the trees...How can I genereate a LAS-file out of a common pointcloud (xyz) and a corresponding image (orthophoto tif)?I already played with PointCloudCombiner, SurfaceModeller and PointOnRasterOverlayer, but nothing resulted in my expectations. Thx in advance! -Maria
Hi,I'm trying to get a Riegl laser scanning project (.RDB or .RSP) into FME. I'm able to add a Reader, but when I attach an Inspector or otherwise add any transformer, it fails. This is the error message:"RDB Reader: Invalid dataset. File '.rds' does not exist. Please ensure both a data and an index file exist in folder '' and you have sufficient privileges to read them."How can I best prepare a Riegl scan for FME proccessing? Thanks in advance for any help you can provide.
Is it possible to explode blocks using a transformer? Maybe in Python?
Hello,anyone knows how to read STEP files which contain 3D objests? It seems that Parasolid platform is much overlooked in FME. I am not particularly fond of Parasolid, however it is quite a widespread industry standard.Any comments are welcome.
Hi, I am trying to read a multipatch geometry from ESRI File Geodatabase and getting the following error:FME API version of module 'FILEGDB' matches current internal version (3.8 20170315) FileGDB Reader: Feature class '*****' has shape type 'esriGeometryMultiPatch' which is unknown to FME. Skipping feature class (I am using OSX version of FME Desktop 2017.1, build 17539). I was wondering if it's supported on Windows with FGDB (ArcObject based format). Is MultiPatch Geometry reading supported by FME using Shapefiles?I appreciate any advice on this (puzzling for me) question.Kind regards,Alexander