Using readers and writers to extract and load data.
Recently active
I want to write areas with holes as "osm_relation_type=multipolygon".It works fine when I give the objects directly to the OSM-writer (FME does all the work).However, I would like to assign the node/way/feature-ID myself and determine the number of vertices of a "way" myself.I tried following workflow:Getting a "feature-ID" to the areaSplitting the areas in simple features an features with holesExtracting the outershell and holeWriting the tag "role=inner" (hole) and "role=outer" (outershell) to the geometrySplitting the geometry after 1964 (e.g. year of birth) verticesCopy the "feature-ID" to "feature_relation_id"Getting a "way-ID" to the wayJoining a feature and it's ways by "feature-ID" and the attribute "feature_relation_id" an creating the members (ref/role/type)Dropping the original feature-geometryAdd the attributes "user", "timestamp", "version"
Hello, We have a workspace with transform a Geodatabase file in more thant 300 dwg based on surface. When I open the dwg with AutoCAD, I have a message like below. It says that "file was written by a school version of Autocad and A text is written in the trace banner". (Print Screen 1) THe workspace run with the version of FME : FME(R) 2018.0.0.2 (20180414 - Build 18301 - WIN64) and the version of AutoCAD I chose to write it's AutoCAD 2010 I have the same type of message with files (Print Screen 2 wrtten with FME(R) 2019.1.0.0 (20190710 - Build 19608 - WIN64). The message the files was written by a application which hasn't been developped by Autodesk or which hasn't got an Autodesk's licence Can you help me with this issue ?It's not very good to have this kind of message in file to share for internal and external purpose. I can send files if necesssary. Best Regards Bernard DinonPICC_Crisnée-Odeur.dwgOSP3_2020_Blegny_Plan_20200319.dwg PICC_Crisnée
Hi, How can I broken the attached JSON file into attributes? Thank´s
Hi, I'm looking for a way to automatically generate URLs for each feature in an ArcGIS Online feature service and add it as an attribute. If possible I also need the URL to zoom into the specific feature instead of opening the entire layer view. The URL will then be attached to an email body to allow the necessary people to view what feature is requiring repair. Has anyone been able to do something similar to this or have any ideas of how I can accomplish this task? Thanks!
I'm trying to read a .dgn-file with Bentley MicroStation Design (V8) reader. When i change parameter to group element by Geometry instead of Level names i get this error. Anyone know why i can read elements by level names but not with geometry? 2020-06-03 13:14:04| 15.0| 0.0|ERROR |f_0: Lookup table `DESIGNGEOMIgdsTypeToGroupLUT' doesn't contain key `igds_oriented_arc' or have a default value
HiI have created cesium 3d tiles from a shapefile. The screenshot with pink 3d cylindrical shape shows that. I would like to add border and vertical lines as you can see in the sample screenshot from google earth below: Can anyone help on how I can do that?
Hi list.We're importing data from customers on a daily basis, and we utilize the strategy of creating a new schema for the new data with the date included, e.g. "Fiber20200602" (with yesterday's data still in schema "Fiber20200601"). The tables and views in each "day-schema" is identical.I want to have FME read tables from the latest schema, and I use an SQLExecutor the generate the wanted schema name. But how do I utilize it in FeatureReader ?I added two tables under "Feature Types to Read" (by point and click). This worked very nicely.Using the text editor I then changed the hardcoded schema name to be my variable. This removed my two output ports, even though my "Output Ports" was set to "One per Feature Type".I then tried to change the setting to "Specified", and added the two tables as fixed schema. This regenerated the output ports, but the read input data was output on the "Generic" port none
I want to transform a Personal Geodatabase to a PostGIS database. In my Personal Geodatabase are Polygons (which also have multi parts). I used an Aggregator Grouped by OBJECTID of the features to create Multipolygons. Unfortunately this resulted in a geometry collection, so I used a GeometryRefiner which was suggested to me, but this only converted the Geometry collection back to Polygons. I also applied a GeometryFilter to check that there are only Areas in the dataset - this is actually true. So, how can I identify the error? And how can I create Multipolygons so that my transformation will be successful?
When investigating access to geopackages from network drives, a temporal difference in loading behavior between geopackages created by FME and geopackages created by QGIS was determined.In comparison, GeoPK created in QGIS will load 10 times faster when opened in QGIS than GeoPK from FME.The reasons for this behaviour and an evaluation of possible steps to remedy the problem could be investigated. Differences:geometry ConstraintFME: = GEOMETRYQGIS: = POLYGONDimension ConstraintFME: = xyzmQGIS: = xyVersion des GeopackagesFME: 1.0QGIS: 1.2Probably the difference depends on the version of Geopackage:FME: 1.0QGIS: 1.2 Questions:What does the time difference depend on?If from version, then how can the version in FME be changed from Geopackage 1.0 to 1.2?Thank you in advance
Hello, i have 3 csv writers, one is a header record from an sql database that has 10 fields. the second is the main body of the file i'm writing and this has 12 fields. the third a footer record again read from a sql database. to write them as one csv output i use a file name attribute the same for the 3 files with the second and third appended. my problem is the output file only shows ten fields not the twelve as defined by the structure in the writer. does anybody know how to overcome this. Thanks
I have a shape file with points and I would like to get the points which are inside an Autocad-boundary. I tried it with Pointonareaoverlayer and spatial filter, but every point goes to the 'failed'output :-S....It isn't rocketscience, but I can't fix it.Who could get a look at my workbench and fix it? It would be great! :-DThis is the input:
I'm new to FME, so if there's a better option it would be greatly appreciated: I have multiple geotiffs (georeferenced black and white aerial phtographs) that I want to convert to a single ECW for use in Geoserver. As there were issues with black and white I set the cut off edges (which contained labels e.g.) in MS Paint before georeferencing in QGIS to RGB red (as these could be manually set to nodata in QGIS).So the corresponding geotiffs have all band 0 (red8) value 237 / Band 1 (green8) value 28 / Band 2 (blue8) value 36 (and a band3 alpha8 255) for the nodata values. I'd like to have this RGB value 237, 28, 36 set to be interpreted as extra nodata value or set to be replaced by value 0 and add this (with the other value 0 for nodata for the normal background, as the geotiffs are not fully upright) to the ECW as nodata.I tried rasterPaletteExtractor but it rejected the geotiff. Or should they all be extracted by band first (bandselector) or should it be done in some way
Hi.I have LiDAR data in .asc and .las formats. I also have .shp file points that I would like to attach the elevation from the LiDAR. How would I go about this?Any help wold be much appreciated.Paul
I have a raster maps (old land use maps) that I want to digitize into shapefiles for ArcGIS. I am new to FME and not familiar with the interface. Is there a way to do this efficiently? I have attached the map to this message. The map jpeg is geo-coded. It also has a blue grid overlayed that does not need to be digitized. I would like to retain the different colors as separate layers.
Trying to run very simple workspace read several DWG files and write them back out to new files with the AUTOCAD_OD writer. Using FME 2018. I have set a path to the Template file and the shape file folder (which I take to be fonts & linetypes), but it keeps erroring out with "Shape defined within template is not stored. Error." Any suggestions?
I'm trying to update some feature service layers in AGOL from a file gdb, but I'm having some issues with the change detector. Many of the layers are working fine, and some that didn't work at first could be fixed by unchecking the "check geometry" option. Unfortunately, some of my change detectors are still processing many of the features as "updated" (I have made no changes to the layers), even with the geometry option unchecked. I have also tried to use a coordinate rounder with no success, and now I'm not sure what else I can do. If I try to continue with the update, I get an error 1019. Any help would be appreciated!
Hi,I'm using FME 2019.1 and would like to insert an image (raster) into an DWG-file. I cannot find any detailed description regarding this and my attempts all end in an error saying 'Failed to write raster with raster reference '1', ignoring texture'.I'm using a reader to read either a GeoTIFF-, JPEG- or PNG-file and send it to an AutoCAD RealDWG writer without any transformations.Could anyone please upload an example FME-file that does this? Thanks for your help
Hi,I tried to create a FME Server App with drag and drop functionality. Seems "drag and drop" only works with text files and not e.g. shapefiles?
Hello,I'm using a series of 'SQL Executor', 'FeatureWriter' and 'AzureBlobStorageConnector' transformers to extract data via an Oracle SQL connection, write it to a .csv file (via a 'TempPathnameCreator') and upload it to Azure Blob Storage. It has been working, albeit intermittently. More often than not it is failing to write to Azure Blob with a rejection code of "UPLOAD_ERROR" and a rejection message of "'('Connection aborted.', timeout('The write operation timed out'))". I'm unsure if this is something I can fix, or if the problem is on the FME end, or the Azure end. Any help would be greatly appreciated!
i would like to ask , how could How could i organizing the shape of the graphic then save it as PDF i mean , to save the graphic from inspectorFile > Save data As in the Data Inspector, and save it as a 3D PDF format. but i want to show the graphic in organized as shown as Picturei have different point connect together to the main point and i would like to organize the graphic as picture ,Main point and under this point the connection of lines to different points , i got already the relation between each main point and the another points . so i know each main point and connecting points to it . it does not matter if i change the length of the lines .it will be nice if also show the name of each point on the graphic .Thanks in advanceFME 2018
Hi again, Thanks @andreaatsafe for helping me with my previous question. I have a follow up question about linked models. Is there a way to know if there are any models linked to a file? I would expect to see this in the file metadata information? I found this model online from here which you can download and contains linked models. I was hoping to be able try and combined a package of linked models but at the moment I cant tell if a model is linked or is it's own model.
Hi,I extract the value in row which begins by FXXXXX (= fci field) and all the values from row 12 until the end. So, on the one hand, i've got 1 feature with 1 column (= fci = FXXXX) and on my other hand, 5 features with 16 columnsOn output, i want to add fci field on my 5 features.I've tried to use FeatureMerger/FeatureJoiner transformers with Requestor = 1 and Supplier = 1, but it doesn't workBut, i don't found the way to merge fci value with my other columns.How can I do that ?Thx in advance for helpingfci_suivi_commande_acces.fmw
I am looking to convert csv files to point shape files. Each attribute in the shape files require a specific format. Character string, date and double format all create as expected. The trouble comes with the attributes that require to be set as floating point. FME always defaults the floating point width/precision to 13.11 which adds additional zeros on to the values when viewing the attributes in the shape files. In this case the attributes required to be floating point are x, y, z, roll, pitch and yaw of aerial image photo-centres. Ideally the floating point width/precision needs to be 13.3 for XYZ and 9.4 for roll/pitch/yaw. The image below shows our validation tool used on the shape files output from FME. With expected fields at the top (green highlight) and fields found in the shape file below (red highlight):The additional zeros are not seen when viewing the shapefile in FME Data Inspector 2019.1, however they are visible when viewing the shape file in other GIS packages such a
Hi!I'm trying to create heightmaps (Grayscale PNG raster based on elevation/z-value) from multiple point clouds that make up a very large area.It can be done by combining all the point clouds with the PointcloudCombiner and then use the RasterDEMGenerator to create a large raster. This can then be clipped into smaller rasters of the desired size. However, creating the raster takes an increasingly long time (several days) when the raster becomes very large.Because of this I instead created a raster from each separate point cloud (and in smaller combined point clouds) and then merged them into a big raster before clipping them into the desired sizes. This was insanely much faster. However, I came across a new issue. When creating a raster from the separate point clouds, the values around the edges are not consistent with the rest of the point cloud, which creates and edge along the border of the raster. When merged together, they can be seen as lines that make out the separate raster
I want to automate the process of downloading and reading the GNAF dataset from www.data.gov.auThis is open data, so anyone can download it.GNAF is the Geocoded National Address Filehttps://data.gov.au/dataset/ds-dga-19432f89-dc3a-4ef3-b943-5326ef1dbecc/details?q=GNAFThe particular dataset I want is the zip file "MAY 2020 - PSMA G-NAF(ZIP)" (though of course, next month, the title will change)https://data.gov.au/data/dataset/19432f89-dc3a-4ef3-b943-5326ef1dbecc/resource/4b084096-65e4-4c8e-abbe-5e54ff85f42f/download/may20_gnaf_pipeseparatedvalue.zipCan FME download the zip file and then read the files within?