Using readers and writers to extract and load data.
Recently active
I'm trying to read a SpatiaLite table with a Primary Key Unique ID (PKUID) field, made in QGIS. All the fields of the SpatiaLite table can be read, except for this PKUID field. Even an AttributeExposer does not do the trick. Is there a reason for this? For the moment, I created a workaround: I read the table, together with the spatial data, in a SpatiaLite reader. Then I read the same table in an SQLite reader, which can detect the PKUID field, but does not contain the spatial data. A FeatureMerger does the rest.
I have successfully implemented a WorkspaceRunners that run a workspaces that read in from CSV files, IFC files and Shapefiles. However trying to implement a similar WorkspaceRunner to read a batch of Sketchup files fails. If the WorkspaceRunner sends the Source filename that the Workspace being called was created with it works fine. However sending another Source filename, the workspace being called fails to read that file. On a different note, I cannot see how to use WorkspaceRunner to read a batch of Feature Datasets in a geodatabase.Thanks
I am creating a Spatialite database with FME 2016.1 64 bit. I have both polygons and lines. Polygons shows up perfectly, but the lines are all over the place. I have added a picture showing the lines that should have depicted a road network in a municipality. Have anyone had the same experience or any idea why the lines drawn like this? I have been trying to adjust how ArcMap reads the data with the "query dialogue" but no success. My ArcGIS version is 10.3.1
I have 13000+ CSV files, all containing around 13000 rows. These CSV files are arranged in 146 different folders. All CSV files have the same schema with ; as separator. These CSV files contain about 175 million rows of data combined. The folders are named as seen in the picture below (for example ...\\CSV_folders\\5785xxx)CSV files are named like these:I already tried to copy all CSV files to same directory and run them to one GDB with FME. This went well... but resulted too heavy ESRI GDB that takes forever to search through. (175 million rows, around 20GB)Now I would need to make things a bit differently. I would like to work with FME to create one ESRI Geodatabase. It should contain tables named like these folders containing CSV files. A table in the GDB should have all the CSV files loaded in the table, that are inside the original folder. This would split my 175 million rows to 146 tables, making it a bit faster to search trough with Arcmap.So my problem is, how to make FME read
Does anyone have an example of using the JSONUpdater? I am trying to update multiple Json files (up to 50) without opening them up and finding my value to change but am looking for FME to help fill this gap. Thank you in advance!
Hello,I'm exporting OBJ files from a CityGML dataset. In the mtl file, FME write a Tr attribute. Can somebody please tell me what is this parameter (I don't see it in the wavefront format definition)?
I have a workspace that contains an ArcGIS Portal writer with mixed-case field names. It runs without a problem when first creating the feature service on ArcGIS Portal. However, when I attempt to use that same workspace to write updates to that feature service, I see warnings similar to the following: ArcGIS Online Feature Service Writer: Attribute 'myFieldName' on feature type 'Feature_Type' does not match any field on the corresponding layer/table. The attribute will be ignoredIf I check the feature service itself, I can see that all the mixed-case field names have actually been set to lowercase (so, myFieldName is actually set to myfieldname).
Can I find out how to use FME to transfer data between programs I am using? To export? Import?
I'm trying to convert XYZ point cloud to DEM so I can generate a Minecraft world. After searching and reading "How to make Minecraft worlds" article I saw the Norway example (las2MinecraftFMEpediais workbench) by @dmitribagh similar to what I'm trying to implement, unless it is using classification attribute values (e.g. 2 for ground, or 5 for vegetation), while my XYZ point cloud doesn't have these attribute values.In the Norway example, the point cloud has another classification attribute values for water (9 or 18), while the one I have has no points for water or spaces under bridge for example. I'm attaching a picture of my dataset in the FME inspector. How could that XYZ be used to make a Minecraft world out of it? Appreciate any advice or suggestions. Thanks
Hi,Can anyone answer a LiDAR point class classification question? According to the ASPRS standard for point class classification, the following class relate to vegetation:3 – Low Vegetation 4 – Medium Vegetation 5 – High VegetationCan anyone tell me whether there are actual ‘standardised’ (above ground) height ranges associated/relating to each of the vegetation class? If so what at the numeric values? For example; 3 – Low Vegetation – 0.0m to 0.5m 4 – Medium Vegetation – 0.5m to 1.0m 5 – High Vegetation – 1.0m to >>mIf there are NOT any standard numeric height ranges; can anyone explain what the Low, Medium and High descriptions actually mean in reality? I have looked at various ASPRS documents but can not find any form of detailed explanation.ThanksRob
How can I I set the workspaceRunner parameter 'FME Workspace' to my FME server path containing uploaded workspaces?I have an attribute with the workspace name that gets set dynamically, so I know which workspace to call, but rather than set the path to a network location I would like to run workspaces that exist in the FME server environment.
Hi everybody ,Anybody knows why in the elements type IFMEMultiCurve doesn't apply the offset of the Y coordinate ???.I have a diagram with input V7 microstation and output V8 Microstation and I see that if I put a Offseter with a offset of 4.000.000 applyes the offset to all the elements except to the elements of type IFMEMultiCurve (Type 33 of microstation).Maybe another way to apply offset to elements ???Any idea ?? , thanks for the help !!
I'm trying to connect to an unversioned table that has archiving enabled. I'm using the Esri Geodatabase (ArcSDE Geodb) reader. I connect as the owner of the table, the same user that was used to enable archiving. In the table list i cannot see the table ending in _evw (the database view containing the archived information), only the feature class itself. Should I be able to see the _evw-table?I add this Archive Where clause: GDB_FROM_DATE > 20070101090000When trying to read the features, I get this error message: "Invalid archive where clause. The archive where clause must be in the format 'GDB_FROM_DATE|GDB_TO_DATE <logical operator> <date> [AND GDB_TO_DATE <logical operator> <date>]' and be space delimited."What am I doing wrong? Are there any other fields I should have filled in? Could the date format be wrong? There are no historical versions or historical markers in the database.
In the FME Server Web UI, the Help > Documentation link returns me with a "Sorry, Page Not Found" error -- what gives?!
I am trying time entry from a SQL table to Excel to be imported into our time entry software. I want to create one worksheet that contains all employee entries and then an individual worksheet for each employee in the same workbook. I can get it to do one or the other but not both at the same time. SO far I know if I define the sheet name - Time Entry - I can write all the data to one sheet. Or if I set the sheet name to - Employee Name - I get the individual sheets for each employee. I have tried coping the writer and defining the sheet name both ways but that doesn't work.
Hi allI've created a WMS service that streams GeoJSON as the response for the GetFeatureInfo operation. At first I was creating the JSON using the JsonTemplater connected to a Text File writer. When I tested the workspace the result displayed directly in the web browser. Problem was I had some formatting issues in the returned JSON that I'd have to deal with.I realized that if I switched to a GeoJSON writer the formatting would be handled for me. This works great but when I test via a web browser I get a file download instead of the a direct display of the returned data in the browser.I think it's caused by the Content-Disposition header in the request response.This is the response when using the Text File writer:And this is the response when using the GeoJSON writer:Is there any way to remove the Content-Disposition header when streaming from a GeoJSON writer?Update:I've used the JSONTemplater to create a return JSON with the same structure as the GeoJSON would hav
Hi,I have a hundred of mapinfo files that I would like to convert to shapefile. It is obvious to write a workspace that works for one file but it not obvious for me to write a batch (MSDOS) that will convert all the mapinfo files.I tried to riun my workspace in a batch script but it is not working when I'm changing the SourceDataset_MITAB to another mapinfo file."C:\Program Files\FME\fme.exe" Y:\tmp\siurs\script\mitab2shape.fmw --SourceDataset_MITAB C:\Users\xkaptar\Documents\SIURS\projet\mapinfo\Ville.tab --DestDataset_SHAPE C:\Users\xkaptar\Documents\SIURS\projet\shapefileWhat I want is to have an input file <filename.tab> and the output should be <filename.shp> (with the other extensions <filename.shx>, <filename.dbx>, ...).Thanks
I am trying to get the last 6 or 7 characters from an attribute called [event_name], and am using the built-in Open Text Editor on the AttributeManager transformer to extract this substring. But it comes out like this:@ReplaceString(@Substring(@Value(event_name),@FindRegEx(@Value(event_name),M[1-9]),@StringLength(@Value(event_name))-@FindRegEx(@Value(event_name),M[1-9])),-,_)which I think looks horrible and is difficult to understand. Is there a way I could break this down into multiple lines with local variables, like you do in a Python startup script?
Hello, Feature Type RunwayTimeSlice (Runway Class (http://webprisme.cfmu.eurocontrol.int/aixmwiki_public/bin/view/AIXM/Class_Runway" target="_blank">https://extranet.eurocontrol.int/http://webprisme.cfmu.eurocontrol.int/aixmwiki_public/bin/view/AIXM/Class_Runway)) has an Attribute annotation{}. But it doesn't find its way into my XML File. ;) I tried it the same way as shown in the AIXM Demo for responsibleOrganisation (EU Airports Demo (https://knowledge.safe.com/articles/How_To/AIXM)), but it doesn't work. What am I doing wrong? Shouldn't this one produce something like this?: <aixm:annotation> <aixm:Note gml:id="uuid.f19ffb15-d86b-4336-a8e2-04f3af652350"> <aixm:purpose>REMARK</aixm:purpose> </aixm:Note> </aixm:annotation> Help is appreciated :) Melanie
Dear FME-Users, I’d like to transform data from raster to vector (e.g. shapefile) and add attributes. The transformer “RasterToPolygonCoercer” works, but the second one “AttributeCreator” doesn’t add the desired attribute. I’ve already verified the output-shapefile in ArcMap. The second step includes to read and classify attribute-data from raster, classify them by breakpoint and add them to the new attribute. Maybe someone of the community here have ideas and can help me. Thank you so much. :) Best regards!
I want you to show how to convert a Mapinfo workspace into a AutoCAD DWG file, step by step process.
Hi,I've trawled the knowledge center and have not found a topic or question which covers this, so hopefully I'm not repeating a previous post..I'm trying to merge two MapInfo TAB files (each with the same structure), but coming from different 'Directory and File Pathnames' readers. Let's call the files A and B. File A is the master layer and file B contains features that I want to insert into File A. If these files were read in as MapInfo TAB readers, it would be simple to append the two together. However, as the writer has to be dynamic and the readers are Directory and File Pathnames I cannot do this easily.I have got to a point where the features from File B are being inserted into File A (and writing out in the correct structure) - using FeatureReaders and FeatureMergers. However, the attributes aren't coming through from File B,only the geometry is apparent in the resulting file that is written. There are no attributes present except for the ones coming
Hello, I am new to FME, recently started to work on FME Desktop 2014. I am looking to convert any format to CSV. My requirement is to deposite output CSV to same input folder. e.g. If user selects c:\\temp\\test.shp then test.csv should be written to c:\\temp\\folder. Currently I am able to convert the file but I am not able to set output path same as input path. I am not sure how to achieve this.Any pointers in the right direction will be appreciated. Regards, john
Hi, I am performing a CAD reprojection in FME and it has messed up my the text layers. I am reading and writing the data dynamically. Any ideas of what might cause the text size to blow up? Any parameters to tweak?Thank so much for the help