Using readers and writers to extract and load data.
Recently active
I have a raster maps (old land use maps) that I want to digitize into shapefiles for ArcGIS. I am new to FME and not familiar with the interface. Is there a way to do this efficiently? I have attached the map to this message. The map jpeg is geo-coded. It also has a blue grid overlayed that does not need to be digitized. I would like to retain the different colors as separate layers.
Trying to run very simple workspace read several DWG files and write them back out to new files with the AUTOCAD_OD writer. Using FME 2018. I have set a path to the Template file and the shape file folder (which I take to be fonts & linetypes), but it keeps erroring out with "Shape defined within template is not stored. Error." Any suggestions?
I'm trying to update some feature service layers in AGOL from a file gdb, but I'm having some issues with the change detector. Many of the layers are working fine, and some that didn't work at first could be fixed by unchecking the "check geometry" option. Unfortunately, some of my change detectors are still processing many of the features as "updated" (I have made no changes to the layers), even with the geometry option unchecked. I have also tried to use a coordinate rounder with no success, and now I'm not sure what else I can do. If I try to continue with the update, I get an error 1019. Any help would be appreciated!
Hi,I'm using FME 2019.1 and would like to insert an image (raster) into an DWG-file. I cannot find any detailed description regarding this and my attempts all end in an error saying 'Failed to write raster with raster reference '1', ignoring texture'.I'm using a reader to read either a GeoTIFF-, JPEG- or PNG-file and send it to an AutoCAD RealDWG writer without any transformations.Could anyone please upload an example FME-file that does this? Thanks for your help
Hi,I tried to create a FME Server App with drag and drop functionality. Seems "drag and drop" only works with text files and not e.g. shapefiles?
Hello,I'm using a series of 'SQL Executor', 'FeatureWriter' and 'AzureBlobStorageConnector' transformers to extract data via an Oracle SQL connection, write it to a .csv file (via a 'TempPathnameCreator') and upload it to Azure Blob Storage. It has been working, albeit intermittently. More often than not it is failing to write to Azure Blob with a rejection code of "UPLOAD_ERROR" and a rejection message of "'('Connection aborted.', timeout('The write operation timed out'))". I'm unsure if this is something I can fix, or if the problem is on the FME end, or the Azure end. Any help would be greatly appreciated!
i would like to ask , how could How could i organizing the shape of the graphic then save it as PDF i mean , to save the graphic from inspectorFile > Save data As in the Data Inspector, and save it as a 3D PDF format. but i want to show the graphic in organized as shown as Picturei have different point connect together to the main point and i would like to organize the graphic as picture ,Main point and under this point the connection of lines to different points , i got already the relation between each main point and the another points . so i know each main point and connecting points to it . it does not matter if i change the length of the lines .it will be nice if also show the name of each point on the graphic .Thanks in advanceFME 2018
Hi again, Thanks @andreaatsafe for helping me with my previous question. I have a follow up question about linked models. Is there a way to know if there are any models linked to a file? I would expect to see this in the file metadata information? I found this model online from here which you can download and contains linked models. I was hoping to be able try and combined a package of linked models but at the moment I cant tell if a model is linked or is it's own model.
Hi,I extract the value in row which begins by FXXXXX (= fci field) and all the values from row 12 until the end. So, on the one hand, i've got 1 feature with 1 column (= fci = FXXXX) and on my other hand, 5 features with 16 columnsOn output, i want to add fci field on my 5 features.I've tried to use FeatureMerger/FeatureJoiner transformers with Requestor = 1 and Supplier = 1, but it doesn't workBut, i don't found the way to merge fci value with my other columns.How can I do that ?Thx in advance for helpingfci_suivi_commande_acces.fmw
I am looking to convert csv files to point shape files. Each attribute in the shape files require a specific format. Character string, date and double format all create as expected. The trouble comes with the attributes that require to be set as floating point. FME always defaults the floating point width/precision to 13.11 which adds additional zeros on to the values when viewing the attributes in the shape files. In this case the attributes required to be floating point are x, y, z, roll, pitch and yaw of aerial image photo-centres. Ideally the floating point width/precision needs to be 13.3 for XYZ and 9.4 for roll/pitch/yaw. The image below shows our validation tool used on the shape files output from FME. With expected fields at the top (green highlight) and fields found in the shape file below (red highlight):The additional zeros are not seen when viewing the shapefile in FME Data Inspector 2019.1, however they are visible when viewing the shape file in other GIS packages such a
Hi!I'm trying to create heightmaps (Grayscale PNG raster based on elevation/z-value) from multiple point clouds that make up a very large area.It can be done by combining all the point clouds with the PointcloudCombiner and then use the RasterDEMGenerator to create a large raster. This can then be clipped into smaller rasters of the desired size. However, creating the raster takes an increasingly long time (several days) when the raster becomes very large.Because of this I instead created a raster from each separate point cloud (and in smaller combined point clouds) and then merged them into a big raster before clipping them into the desired sizes. This was insanely much faster. However, I came across a new issue. When creating a raster from the separate point clouds, the values around the edges are not consistent with the rest of the point cloud, which creates and edge along the border of the raster. When merged together, they can be seen as lines that make out the separate raster
I want to automate the process of downloading and reading the GNAF dataset from www.data.gov.auThis is open data, so anyone can download it.GNAF is the Geocoded National Address Filehttps://data.gov.au/dataset/ds-dga-19432f89-dc3a-4ef3-b943-5326ef1dbecc/details?q=GNAFThe particular dataset I want is the zip file "MAY 2020 - PSMA G-NAF(ZIP)" (though of course, next month, the title will change)https://data.gov.au/data/dataset/19432f89-dc3a-4ef3-b943-5326ef1dbecc/resource/4b084096-65e4-4c8e-abbe-5e54ff85f42f/download/may20_gnaf_pipeseparatedvalue.zipCan FME download the zip file and then read the files within?
HI!I have an issue updating a feature in ArcGIS Online. I am using a change detector and FME confirm that agol is updated. I am generating a list to check the changes. But in AGOL the features are not updated. How can I solve this problem?
Hello folks,I have another question for you , which I'm having trouble solving. I have made an IFC 3d model which I try to import into Revit. Although my walls are redirected to the Walls family in Revit, they each make up an entire family with their own instance. So I figured I would use the example of the LOD 200 Ifc file from the FME blog here in the BIM examples to see if this would give the same result. Now when I import the sample data into Revit I get the same 'error' that I get with my own model. The only difference is that in the LOD 200 sample some of the walls are redirected to the basic walls family whilst others are getting redirected to their own family with their own instance. So my question: How do I get my walls in the basic wall family of Revit. At which point in the converting/importing process is this 'error' taking place and how can I solve it. Because now I can't alter the family of the walls when I import them into Revit. Thanks in adva
I'm constructing an XML query for a WFS service by using an XMLTemplater. The ROOT element is this:<Filter><Or>{fme:process-features("SUB")}</Or></Filter>And the SUB element, per feature, is this<PropertyIsEqualTo><PropertyName>identificatie</PropertyName><Literal>{fme:get-attribute("bag_vbo_id")}</Literal></PropertyIsEqualTo>Store in an attribute then use that feature to trigger a FeatureReader and use the query attribute. This works fine and results in a working query. Except when there's only one feature, in that case the WFS service seems to bork about the unnecessary <Or> </Or> tags.My workaround:StringSearcher to count the number of times </PropertyIsEqualTo> occurs (i.e. the number of sub elements)ListElementCounter on the list of matchesTestFilter to test for the number of elementsIf 1 StringReplacer to replace the <Or> and </Or> with empty stringsI can't help but think there's got to be a
Hi we run into the following issue when executing a number of jobs resulting from an FME Server Schedule on a time that our Oracle database was unavailable. The jobs that read data through an SQLCreator got the same error message ORA-00257 however the job was reported success in FME Server job log. The jobs using Oracle Reader were reported status failure. Other people having same experience? Is this behavior meant to be?
Hi, In my workflow, I am creating an .xls file with some sheets, there are two columns. One of them with the value is with the word sector and corresponding number. Eg: Sector 1, Sector 3 ... How do I enter these values in ascending order. Currently it looks like this: Sector 4Sector 4Sector 6Sector 6Sector 3Sector 3Sector 1Sector 1 Sorting is being done alphabetically, by another column. Thank´s
Having trouble updating attributes on a MySQL db table. We do not receive any errors. The workspace is doing what we want, but not writing an update.
Hi all, I have an excel file with several lines. I have a data field and countries, I need to validate which countries have less than 1 line with data between the last 7 days or the week before, How could I do that?Thank you
Hello, is there a way to import GTFS data into a PostGreSQL database with FME ? Thanks for your help.
Hello FME People,I am in the process of creating a workspace that reads data from geopackage and writes to SQL Server database, after performing a few transformations and checks.I am using Python to perform pre-population of some tables in SQL Server (otherwise FME wouldn't be able to write the new tables due to schema restrictions).At the end of the Python script I run the following statement that calls FME: os.chdir("Z:\\CurrentProjects\\school-uplift\\fme")os.system("""fme.exe geopackage2mssql_spatial.fmw" --DestDataset_MSSQL_SPATIAL_8 "SCHOOL_NAME" --SourceDataset_GEOPACKAGE_12 "..\\gpkg\\Service component type.gpkg" --SourceDataset_GEOPACKAGE_10 "..\\gpkg\\Service component link.gpkg" --DestDataset_MSSQL_SPATIAL_12 "SCHOOL_NAME" --FEATURE_TYPES_2 "ls_carp ls_contours ls_gate ls_landscaping ls_road ls_tree ls_bollard ls_embankment ls_fnce ls_gden ls_path ls_pond ls_steps ls_wall" --SourceDataset_OGCGEOPAC
Problem:I'm having trouble converting 3D Sketchup building data to a more simplified PostGIS 3D Polygon (ST_Polygon or ST_MultiPolygon). The SketchUp buildings data are not represented as 3D volume representations but made of series of parts representing the building which need to be recreated to polygon objects and output to POSTGIS DB.Aim:We need to reconstitute the building parts to solid polygon 3D representation losing the separate SketchUp parts of faces, edges and, vertices. Our aim is to simplify the building to show the outer most extent (removing detail/vertices within the building).The Process:We're using the GeometryPartExtractor to get the SketchUp data into a usable format and geometry coercer to fme_polygon. The complexity of the vertices and ordering of them has meant we get some unwanted results when re-constituting the geometry after partextraction and using PostGIS geometry conversion or geometry fix commands (ST_MakeValid). The FME Inspector seems to rende
I have created a new azure installation following this guidance:https://docs.safe.com/fme/html/FME_Server_Documentation/AdminGuide/Kubernetes/Kubernetes-Deploying-to-AKS.htm When I look at the logs to my fmeServer Postsql service from powershellkubectl logs fmeserver-2019-1590072608-postgresql-0I get the following with authentication errors:INFO Initializing postgresqlpostgre INFO ==> No injected postgresql.conf file found. Creating default postgresql.conf file...postgre INFO ==> No injected pg_hba.conf file found. Creating default pg_hba.conf file...postgre INFO ==> Deploying PostgreSQL from scratch...postgre INFO ==> Creating postgres user with unrestricted access...postgre INFO ==> Configuring PostgreSQL...postgre INFO ==> Configuring replication parameters...postgre INFO ==> Configuring permissions for config files...postgre INFO postgre INFO ########################################################################postgre INFO Installation parameters
Hi there - We're simply trying to push an SDE feature class into a zipped GDB using the "Insert" and "Truncate Existing" options. However, when we do this we receive a "Feature class must exist" message. The alternatives of using "Create if needed" and "Drop and create" aren't ideal because they recreate a Feature dataset that we don't want to see in the output. Are we doing something wrong? Or is it simply that FME cannot read a zipped geodatabase?Thanks!
Hi TeamI have been excited to use the dgn reader in 2020 that allows you to view Item Set Attributes. It does work in one regard however the issue we are facing is that the item name (attribute) gets prefixed with the set name and therefore you end up with 100's of attributes, even though there may only be really 10. Besides using an iterative Bulk Attribute rename has anyone got any other ideas?You can see in the screenshot below that there are about 15 different attributes (ie Asset, Count, Comments etc) however they come through as a separate attribute for each item set. Thanks very muchDominique