Using readers and writers to extract and load data.
Recently active
Is is possible to expose a shapefile's FID field?Shapefile readers do not list it and I can't find how to expose it.I need to store that field's value in a control field to keep track of the original features.
Hi,I imported a .DWG file with 2500 area features and want to assign them a colour to get, lets say, grey areas. I found this article and tried to apply this solution with the DWG styler in FME Desktop 2021. However, only my lines get the chosen colour, the areas remain the same without any colour. See attached my DWG Styler settings and a screenshot of my dataset. Any ideas? Current output:DWG Styler:
I have a photomesh that looks fine as obj or gltf and when I upload it to Cesium Ion through the webinterface.However, when I use the FME 3DTiles writer and upload that directly, the textures are not illuminated correctly.Is there anything I can do to get FME to output the photomesh correctly?
I am trying to update an ESRI SDE database with data from an ESRI GDB. The matching key between the two datasets is GlobalID. I use an ArcSDE writer and FME 2019.1.Settings in the Writer:When I try to update or delete data in the SDE, I get an error like the following:No rows matched UPDATE query to table/feature class 'XXX' where upper(GlobalID) = N'{C1BD1C13-4C4F-4C05-B3D8-F051F7B0A33F}'The GlobalIDs do exist in the SDE database! I have checked this multiple times.I can update data between two GDBs with the exact same data without problems, so I suspect there is something in the way GlobalIDs is read in GDB vs. SDE databases that do not match. I have tried adding/deleting the brackets {} on the input data using AttributeTrimmer with no luck. The "N" before the GlobalID in the message is not present in the data, and I have no idea why it shows up here.
. Hi,I have a server that is now in Azure which is connected only by Active Directory (Not SQL or Window Auth) .But this option is not available in FME 2018, Is there a work around or I am missing something?
When using the IFC STEP/XML reader and writer as a just plain import > export, I've noticed that some IfcWallStandardCase are automatically converted to IfcTrapeziumProfileDef although the export object name is IfcWallStandardCase. Therefore some the IFC is broken as some object's can be displayed anymore in other software (xBIM Explorer). The issues occurred on a more complex workspace but I've tried it on the most simplified workspace, and there I do have the same issue. Is this a bug or can i do something to fix this?
I'm writing and IFC file and I am writing objects into IfcProxy as there's no other fitting IFC Type at the moment. To better define the type, I am using the default ProxyType attribute. When I write ProxyType as attribute in FME, the IFC file breaks. I can see the information added in the file but apparently the syntax is wrong. The FME output looks like this:#674=IFCPROXY('b4I2bLVTRhe0Uu99isXLTw',#24,'Stone | CCC','Wastewater asset ID: cac582d1-373d-4ff8-bada-9727e139562a',$,#673,#672,.Sewer.,$);In this case ".Sewer." is the ProxyType value. Then I change the IFC file to contain this instead:#674=IFCPROXY('b4I2bLVTRhe0Uu99isXLTw',#24,'Stone | CCC','Wastewater asset ID: cac582d1-373d-4ff8-bada-9727e139562a',$,#673,#672,'Sewer',$);After this change (replacing . with ') the IFC file works and the ProxyType information can be read. Is this a bug or a mistake on my side?
Are FME Desktop and FME Server 2021.0.2 compatible with MSSQL Server 2019? Thanks for any reply!
Does anyone know how to how to create ESRI feature class and Attachment table from a ArcGIS Online Hosted feature service with attachments? I am trying to find the most efficient way to move a hosted feature layer with attachments to a Geodatabase to create a feature class with attachments.
Hi FME'ers! I seem to have a problem doing such a simple task as reading a feature service from ArcGIS Online. I get the error: 2021-05-12 09:56:45| 1.7| 0.0|INFORM|ArcGIS Online Feature Service Reader: Getting feature results 0 to 999 of layer/table '<table name>'2021-05-12 09:56:53| 1.7| 0.0|ERROR |Python Exception <KeyError>: 'GlobalID'2021-05-12 09:56:53| 1.7| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details Has anyone come across this before? Googling the error messsage gets me nowhere. The FS has export rights. Im using fme 2020.2.4.0 (20210304 - Build 20825 - WIN64). Best regards,Anne Kathrine
Using the 'Autodesk AutoCAD DWG/DXF Reader/Writer' we're reading DWG files. Normally this works as expected, but sometimes the DWGs are corrupt. Instead of FME automatically recovering these DWGs, it would be better to fail immediately, as the recovered DWG might miss data, in our experience. I could not find any relevant options in the docs at https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/acad/acad.htm or a related question on these forums. Hopefully somebody can shed some light on this. Thank you in advance.
I have a polygon that has 200 Zone and Bottom fields as Zone1, Zone2, Zone3,...., Zone200 and Bottom1, Bottom2, Bottom3,...., Bottom200 . I am trying to split the polygon to 200 units and create fields called "Zone" and "Bottom". Then populate these fields as Zone1/Bottom1 for unit 1, Zone2/Bottom2 for unit 2 and so on.I am at the writing the attribute stage. I was able to get the values but I couldn't set the values to the final attributes. I attached the workbench template.My current code looks like this:import fmeimport fmeobjects def processFeature(feature): for i in range(1, 201): zone = "Zone" + str(i) bottom = "Bottom" + str(i) zoneValue = feature.getAttribute(zone) bottomValue = feature.getAttribute(bottom)) feature.setAttribute("Zone", zoneValue) feature.setAttribute("Bottom", bottomValue)
I'm doing a simple translation of a polygon dataset from MapInfo TAB to ESRI SHP. However, there's a date field in the MapInfo table (in the TAB file it looks like: DATE_ESTAB Date ;) showing the dates as I want them dd/MM/yyyy e.g. 26/11/1990. I'm trying to use the datetimeconverter, with the output format as %d/%m/%Y and input format as Autodetect FME and ISO. In the Writer I've set the attribute Type to Date and also set an expression @DateTimeFormat(@Value(DATE_ESTAB),<%d/%m/%Y>). But the features don't get this far as all features are output through the Rejected port of the transformer. I know I'm doing something wrong, but it looks like the MapInfo Date format isn't being recognised. When I try to use the FME Universal Translator in MapInfo, the dates come out by default as 1990-11-26 in the Shapefile, which is not what I want.I would be grateful for any help!Thanks
Hello,I'm looking to read all DWGs in a folder and convert them to feature classes inside one GDB, with the feature classes named as the DWG filenames. Currently, I've set my reader to read all DWGs in the folder and put as 'Single Merged Feature Type' so that it's a single input port. Then I followed this thread to use the FilenamePartExtractor transformer and set the fme_basename to the dwg file name. After it's run, it only outputs one feature class instead of multiple. See below for my workflow. Please advise on where I'm going wrong!
Hello,I am trying to merge features where it has a closed polyline and it's derived center point (using CenterpointReplacer) where they are separate attributes in each respective feature. I am using a _count attribute to join on, by FeatureMerger, but it does not pick up the polylines (Requestor), only the points (Supplier). The end result should be separate columns for polyline and point in the same feature.Any help is appreciated. Thanks, @larue
My overall goal is to convert a DGN model to json and OBJ files, which seems to work well for most primitive types of my model (like line segments, arcs, polygons etc.), but not for meshes. When I inspect the data in FME, the coordinates in IFMEmeshes seem to be off by a couple orders of magnitude, I cannot confirm whether the underlying geometry is still correct and it's just shifted or if the data is completely useless.I've tested it with both dgn V7 and V8, various parameter sets for the reader and multiple models and the problem remains the same in all cases. As far as I know I'm using the latest stable version of the software on Ubuntu, but according to my colleagues the bug can be reproduced on Windows machines as well. In Microstation the model is correct and if I export it to an OBJ file I still get the correct geometry, but obviously that way I lose all the additional information from the model regarding the levels etc. If I export the model as DWG in Microstation
Why does my AutoCad reader turn a single text object into 2 distinct rows if it contains a space character? I would assume that my reader would output just 1 row with autocad_text_string = '1-500 EE'.
I seem to hit a limit of 100,000 features when extracting an oracle spatial database of over 150,000 features into PostGIS.The workbench shows only 100,000 and in QGIS the feature count is also 100,000.How can I ensure all features are extracted?Thanks.
I have the following situation. There are multiple excel files with multiple sheets in it. All sheets have the same template. So i use a dynamic FeatureReader to read all the data at ones. And update a single value based on another value in that sheet. There are two problems:1. Is that in cell B1 there is a 'project-name' that is different for every sheet in the dataset.In FME it is not possible to set it to always use the column name as Attribute name so it will use B1 value as column name. Now i have lots of column names that I need to expose and rename. But I don't know on forehand what they will be. A setting that FME will always use column name as attribute name is wanted here. 2. When writing the data I want just one cell to be updated. So I use a dynamic filename and a dynamic sheet name. Then I use the Column Name and xlsx_row_id to identify the cell to update.Then i get the error:Column name 'xlsx_row_id' for sheet '<Generic>' could not be used as a column position.I can
Hello everyone, I want to change the name of the shape file to "asd.shp" rather than "Table1". I need a solution suggestion for this. Also, I don't want to see all the columns in the excel list in my shape file, I need some of them.
Hi there, I'm a experienced FME user but have no experience in writing to ArcGIS portal.I have a hosted feature layer in an ArcGIS portal with three layers. With FME i'am trying to update these layers with new data. I've connected to the portal and imported the feature type definitions from the portal. I've set the layer writer mode to insert and the Truncate first to yes. Tables seems to be truncated and in one layer I see some of the data (670 features instead of 6500). The other layers are empty. There are no errors or warnings in the FME log file. Anybody any idea of what might be wrong?
I am trying to write simple features with/without geometry to elasticsearch. I tried different params but always get this errorELASTICSEARCH writer: {"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"Types cannot be provided in put mapping requests, unless the include_type_name parameter is set to true."}],"type":"illegal_argument_exception","reason":"Types cannot be provided in put mapping requests, unless the include_type_name parameter is set to true."},"status":400}Does anyone have a clue?
I am creating a workflow to check incoming DWGs for compatibility. Ideally I would like to compare it to a template file and find any additional layers that have been added, plus report out a few other things. We want an easy report to accept or reject a DWG coming in from outside. TIA!
Hi,I would like to read dynamic block properties (specifically action parameters fx an angle or a flip state). I have the newest 2021.1 beta version of FME Desktop. Do you know where those properties are stored or are they stored at all? I tried both exploded and not exploded block parameters in the reader but with no success.Thanks!
When writing line features onto a poly line SDE feature class I am receiving the following message: “The error number from ArcObjects is: '-2147215922'. The error message from ArcObjects is: {Number of parts in shape is incorrect for its geometry type}.I have not encountered this error leading up to this point. However, there have been a handful of jobs that have failed on this error. I have reviewed the line(s) in question and have found them to have these characteristics:Vertices >= 2Non-duplicated, stacked, or closely consecutive verticesLonger length than SDE toleranceSingle part line features, not aggregatesNot self-intersectingGeometryValidator, GeometryFilter, and GeometryRefiner have been applied with no success. Also, I created a replica file geodatabase and was able to write the features in with out any issue. I verified that it is specific lines and not only the first feature being written causing the error as well. In summary, the jobs are failing on what ap