Using readers and writers to extract and load data.
Recently active
Hello,I'm looking to read all DWGs in a folder and convert them to feature classes inside one GDB, with the feature classes named as the DWG filenames. Currently, I've set my reader to read all DWGs in the folder and put as 'Single Merged Feature Type' so that it's a single input port. Then I followed this thread to use the FilenamePartExtractor transformer and set the fme_basename to the dwg file name. After it's run, it only outputs one feature class instead of multiple. See below for my workflow. Please advise on where I'm going wrong!
Hello,I am trying to merge features where it has a closed polyline and it's derived center point (using CenterpointReplacer) where they are separate attributes in each respective feature. I am using a _count attribute to join on, by FeatureMerger, but it does not pick up the polylines (Requestor), only the points (Supplier). The end result should be separate columns for polyline and point in the same feature.Any help is appreciated. Thanks, @larue
My overall goal is to convert a DGN model to json and OBJ files, which seems to work well for most primitive types of my model (like line segments, arcs, polygons etc.), but not for meshes. When I inspect the data in FME, the coordinates in IFMEmeshes seem to be off by a couple orders of magnitude, I cannot confirm whether the underlying geometry is still correct and it's just shifted or if the data is completely useless.I've tested it with both dgn V7 and V8, various parameter sets for the reader and multiple models and the problem remains the same in all cases. As far as I know I'm using the latest stable version of the software on Ubuntu, but according to my colleagues the bug can be reproduced on Windows machines as well. In Microstation the model is correct and if I export it to an OBJ file I still get the correct geometry, but obviously that way I lose all the additional information from the model regarding the levels etc. If I export the model as DWG in Microstation
Why does my AutoCad reader turn a single text object into 2 distinct rows if it contains a space character? I would assume that my reader would output just 1 row with autocad_text_string = '1-500 EE'.
I seem to hit a limit of 100,000 features when extracting an oracle spatial database of over 150,000 features into PostGIS.The workbench shows only 100,000 and in QGIS the feature count is also 100,000.How can I ensure all features are extracted?Thanks.
I have the following situation. There are multiple excel files with multiple sheets in it. All sheets have the same template. So i use a dynamic FeatureReader to read all the data at ones. And update a single value based on another value in that sheet. There are two problems:1. Is that in cell B1 there is a 'project-name' that is different for every sheet in the dataset.In FME it is not possible to set it to always use the column name as Attribute name so it will use B1 value as column name. Now i have lots of column names that I need to expose and rename. But I don't know on forehand what they will be. A setting that FME will always use column name as attribute name is wanted here. 2. When writing the data I want just one cell to be updated. So I use a dynamic filename and a dynamic sheet name. Then I use the Column Name and xlsx_row_id to identify the cell to update.Then i get the error:Column name 'xlsx_row_id' for sheet '<Generic>' could not be used as a column position.I can
Hello everyone, I want to change the name of the shape file to "asd.shp" rather than "Table1". I need a solution suggestion for this. Also, I don't want to see all the columns in the excel list in my shape file, I need some of them.
Hi there, I'm a experienced FME user but have no experience in writing to ArcGIS portal.I have a hosted feature layer in an ArcGIS portal with three layers. With FME i'am trying to update these layers with new data. I've connected to the portal and imported the feature type definitions from the portal. I've set the layer writer mode to insert and the Truncate first to yes. Tables seems to be truncated and in one layer I see some of the data (670 features instead of 6500). The other layers are empty. There are no errors or warnings in the FME log file. Anybody any idea of what might be wrong?
I am trying to write simple features with/without geometry to elasticsearch. I tried different params but always get this errorELASTICSEARCH writer: {"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"Types cannot be provided in put mapping requests, unless the include_type_name parameter is set to true."}],"type":"illegal_argument_exception","reason":"Types cannot be provided in put mapping requests, unless the include_type_name parameter is set to true."},"status":400}Does anyone have a clue?
I am creating a workflow to check incoming DWGs for compatibility. Ideally I would like to compare it to a template file and find any additional layers that have been added, plus report out a few other things. We want an easy report to accept or reject a DWG coming in from outside. TIA!
Hi,I would like to read dynamic block properties (specifically action parameters fx an angle or a flip state). I have the newest 2021.1 beta version of FME Desktop. Do you know where those properties are stored or are they stored at all? I tried both exploded and not exploded block parameters in the reader but with no success.Thanks!
When writing line features onto a poly line SDE feature class I am receiving the following message: “The error number from ArcObjects is: '-2147215922'. The error message from ArcObjects is: {Number of parts in shape is incorrect for its geometry type}.I have not encountered this error leading up to this point. However, there have been a handful of jobs that have failed on this error. I have reviewed the line(s) in question and have found them to have these characteristics:Vertices >= 2Non-duplicated, stacked, or closely consecutive verticesLonger length than SDE toleranceSingle part line features, not aggregatesNot self-intersectingGeometryValidator, GeometryFilter, and GeometryRefiner have been applied with no success. Also, I created a replica file geodatabase and was able to write the features in with out any issue. I verified that it is specific lines and not only the first feature being written causing the error as well. In summary, the jobs are failing on what ap
I am building a workbench that uses Workspace Runner to reproject a lot of MapInfo tables. My question is about the workbench that does the reprojection. All the MapInfo tables have different schemas (different columns). How do I build dynamic readers and writers that work with any column structure (but still specifically MapInfo format)
I am building a workbench that uses Directory and File Pathnames Reader and Workspace Runner to run a translation on a bunch of MapInfo tables.I want to only run the translation on native MapInfo tables. Not image tables, WMS table or links to oracle datasets.I can do this easily enough in MapBasic, where I can use the TableInfo() function to return if a MapInfo table is of type TAB_TYPE_BASE.Is there a similar transformer in FME? I have already looked at exposing attributes, but none of them are helpful
Also read the IFC examples here on the forum but i didnt come to a solution because here is no really example from SHP Multipatch to IFC
I have a Workbench. It has a Esri ArcGIS Online (AGOL) Feature Service Writer. It works perfectly. Workbench was daily running successfully. Now yesterday we upgraded from Version 2019.1 or .2 to Version 2020.2 Now i get errors and the Writer cant find the content of the Group anymore.I dont see anything if i want to choose the Feature Service. Not even Groups. The Writer changed from the two FME Versions because in the new Version at Feature Service the ID gets attached behind. That was not in the old Version. If I use the Esri ArcGIS Online (AGOL) Feature Service Reader i see every Group and everything i should see. If my Collegue uses his Account he can see the Groups and everything in the Writer. I dont. Now the Question is it a FME Problem or ArcGIS Online Problem? With my ArcGIS Online Account and the Groups nothing changed only the FME Version changed and now i cant see any Feature Service and before everything Worked perfectly.
im trying to use a ChangeDetector and routing the Updated section to an AGOL writer with a writer mode of Update. however, i keep getting the following error and im not sure how to fix it. "ArcGIS Online Feature Service Writer: Encountered a feature for feature type 'LiftStationInspection_Weekly_table' that is missing the ID attribute 'OBJECTID'. This attribute is require"
When trying to change the data type in the ArcGIS Online writer, the esriFieldTypeDate(width) is not an option. I want to have this type of field because I want to enable time in my hosted feature service.
Hello, we've been working with a client for a couple months to run business rules against dwgs.One of the requirements is to ensure the System Variables BASE and INSBASE X, Y values are set to 0,0 to help ensure that xRef drawings align correctly with the 'base' or currently opened dwgWe have reviewed the following and don't believe what we are looking for is supported with this option and uncertain if what we are trying to unlock is even possible with current 2018.1 release(http://docs.safe.com/fme/2018.0/html/FME_Desktop_Documentation/FME_ReadersWriters/acad/Drawing-System-Variables.htm) Related AutoDesk Links:UCSBASE CommandUSCBASE VariableINSBASE VariableAutodesk Forum Discussion About Thanks for any insight
Hello, I'm trying to get rotation information of a cell which come from a DGN.I found it for text element but not on cell. In microstation the information is present but not in FME, do you have any idea ? In the help here : https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_Transformers/Transformers/dgnstyler.htm it say :OpenCell Rotation Specifies rotation of the cell (in degrees counterclockwise from horizontal). This can be set to any floating-point value between -360.0 to 360.0, or be set to a value taken from an attribute. Format attribute set: igds_cell_rotationBut I haven't this attribute in FME : But here in Microstation you can see the information (50 g = 45 deg)
It seems that the FME translator for Smallworld applies the "unset value" to any field where the value is unset. Is it possible to export a null value instead. We would like to preserve the values as is and not have to try to come up with some convoluted process to deal with it. Only thought I have would be to pick a default value for each field that we know doesn't exist in any of the existing data. We would then have to look for those values after exporting the data from smallworld so we could then again put them back to null. That could be a lot of work for all of the different classes we need to export.
I have a complicated json object that I would like to count the number of elements in one of it's child objects. Given the size and complexity of the original json, I would like to avoid flattening it and using the listElementCounter.
I have worked out that I can use the Fanout feature on both csv and xlsx files, and I need the output as csv files, however outputting to a csv creates separate folders for each file and I need it output to the same file. The second part is that I want the output to start writing on row 2, with each file output to have the same value in cell A1.I know that if i output to excel i get individual files, named based on the attribute I specify, but all the files are in the same folder, which is halfway to what I want.What I cant work out is how to:insert a specified value in cell A1 on every file; andoutput as a csvIs this possible in FME or am i going to have to write a macro for excel that runs through each file, adds the value in cell A1 and then saves the file as a csv?
You can reach me at (613) 447-8306.
I'd also like to be able to analyze and set properties for the feature symbology.