Using readers and writers to extract and load data.
Recently active
Hi, I have a Geopackage raster tileset that contains a raster with multiple zoom levels. I want to split this raster into a series of tiles and export each tile as a TIFF file. My first thought was to use the RasterTiler-transformer and simply split the raster tileset into separate tiles based on a specific tile size (e.g. 500 x 500). However, I can't get this to work. When I run the workspace the resulting TIFF-files contain no data (i.e. they are totally blank). I suspect that this has something to do with the multiple zoom levels in the Geopackage raster tileset, but I'm kind of clueless on how to solve it. Does anyone have an idea on how to solve this? Is it possible to split a Geopackage raster tileset into a series of tiles based on multiple zoom levels? Any help will be appreciated.
Hi all,I have some DBF files that need to be converted to something else (MSSQL tables), but have a problem reading these in FME. The dbf files have associated "FPT" files which are memo files.When reading the DBF files in FME, an error arises "DBF Reader: Failed to read memo file record at block number %0. DBF Writer: Error with memo file. Unable to input data from file 'Y:\\Data Transfer\\WATERCOURSES.DBF'. Error in the DBF Reader. Failed to specify the feature index as constraints on the reader.""DBF Reader: Failed to open memo file 'Y:\\Data Transfer\\WATERCOURCES.fpt' for reading"I have then tried to remove the "fpt" file and doing so allows FME to read the DBF. However, there might be some important data in these "fpt" files that we do not want to lose.My question is what is the problem with the "fpt" files and how can it be sorted out in order to get the dbf files read in FME without removing the fpt fil
I'm using the Data Interoperability extension and I'm attempting to read in a csv file that has a column with a string of coordinates in it. I've tried loading it into the Spatial ETL Tool CSV reader, using the coordinate concatenator and then the area builder. I get a rejected feature warning when I try running the tool. Can anyone offer some pointers for this?
For every feature I have a photo. These photos can have different formats, e.g. png or jpg. The photos are on our intranet. I can only download them with a valid Authorization parameter in the request header. I'd like to write the features to an Excel file, including a photo for every row. How should I go about that?I tried following this tutorial, but the ImageFetcher didn't work because of the missing Authorization header parameter (I don't know how to specify the header parameter in ImageFetcher). An HttpCaller does work. I can download the photos to an attribute or file on my local disk. But I don't know how to feed the photos to the Excel-writer. I'd really appreciate your help on this.Willy
Hello,I'm using ExcelToPDFWriter to export Excel files into PDF. It works fine.But my Excel files are huge and many informations are useless (for me). I would like to decide which rows/columns for the sheets I want to export to PDF.Do you have an idea how I could to that? Changing the Python code maybe?Thanks!
I want to create a plugin that will take some data from the small world and send it to another application. How can I get access to the small world database? What kind of problems can I face?
I'm processing a vector data containing 500000 features to a raster data using numeric rasterizer and then writing it in a raster gdb. The conversion of vector to raster happens quickly but writing the raster in to the gdb takes unexpectedly more time. It runs for hours. I'm not sure how can I improve the writing time. Please help!
Hello !Before going deep into this, I would like know : is there a simple way to read a GTFS, then "translate" it into a graph structure, and write the graph into file ? (XML, GraphML, JSON, GraphJSON, other ?) Thanks in advance !
Hi all, I have several PNG-files along with separate georeferenced PGW-files. How can I somehow import those to FME desktop and convert to a format compatible with Google Earth? What I want is to make this map an overlay in Google Earth. I also have the possibility of downloading the maps in in GML (.xml), ESRI shapefile, or Mapinfo MIF/MID. Whatever works best. I just want to import to Google Earth somehow. I'm completely new to map modelling and FME so please give a really simple solution ^^ Thanks, Ruben
Hi, I am trying to create a KML output which extrudes building polgyons and overlays a Flood Map. Unfortunately I cannot get an output with all of the polygons in a uniform color (see attached image), does anyone know how I fix this issue?Thanks,Aaron
Problem:I have a workbench that reads data from a geopackage and writes this to a postgis table. The workbench simply reads data and writes the data with only one attribute. The primary key, called 'fid', should be generated by postgis and not FME so I do not provide a primary key in FME.This postgis table has a column called 'fid' which is the primary and has a not null constraint. It creates the primary by auto incrementing using 'nextval('mytable_fid_seq'::regclass)'. - The workbench used to work, and has stopped working suddenly- other similar workbenches still work on other databasesAn (unwanted) solutionThe only solution that works is to add an SQL Executor before writing the data. However this slows down the progress a lot. The statement is: 'select nextval('treetops_py_fid_seq') as fid'. I'd rather have a different solution.Adding a counter that generates numbers and write these as 'fid' works, until it finds a situa
Hello, anyone having experience writing Trimble JobXML files (.jxl) according to .xsd? Tips, tricks and best practice appreciated?
I have a DWG file with autocad_surfaces.I want to export these to a line, so that I can use it in ArcGIS Pro.How can I convert the features from surfaces to lines in an ArcGIS File Geodatabase using FME 2018?
Can any one explain why FME have recognised the same excel attribute format as x coordinate in FME version 2018
Hello! For an FME Batch process I am working with the Workspace runner. In the two main FME workbenches a conversion from GeoJSON EPSG 4326 to Shapefile EPSG 31256 is made. In the second main workbench there is a conversion in the opposite direction. My question now is the following: In the Workspace that actually runs the two "main" workspaces I am using the Directory and File Pathname Reader. In this reader I defined the folder, where the Input GeoJSON and Shapefiles are stored. (attached you van find a Picture of the Workspace.) This path I connected to the two WorkspaceRunners (1 for GeoJSON and one for the Shapefile Converter. For source (GeoJSON/Shape) I used path_windows). My Problem is that for the process of Shape -> GeoJSON I always get an error '...se_shape_2.shx' lacks the required extension `shp', altough the shx, prj and dbf file belong to the shapefile. Is there ANY way how FME recognizes that these files also belong to the shapefile? Thanks a
For Example:- I am trying to count no of features from multiple feature classes. output is just showing count, however output should be feature class name and then count. Any help is appreciated.
Hi!I want to create a pointcloud in .las based on a .shp file with point geometries. I used the shp-reader -> PointCloudCombiner -> .las writer. The transformer is doing a great job in creating the point cloud but I'm loosing the attribute values when I write the files. In the translation Log you can see: "LAS writer: the following components will be dropped from the point cloud: grid_code, pointid" Why is that? The grid_code has the data typ (float), the pointid (longInt). This link discribes nearly the same problem:https://knowledge.safe.com/questions/53453/how-to-convert-shp-point-geometries-in-to-las-poin.html?childToView=89696#comment-89696 Thanks!!!Sebastian
I've a file GDB contains Line feature (ways), and Point feature (nodes) and tables for relation contains members and tags. i would like to convert GDB data to osm xml format.I've loaded the tags and members in lists as needed by OSM writer (member{}.type, member{}.role, member{}.ref) and (tag{}.k, tag{}.v) respectively. member listtag listall nodes and ways are written successfully in the .osm output file (xml format) .. all id(s) and ref(s) are correct. the only thing i miss in the xml is part of the relation, as following that output miss the member type=node with role=via and also miss the tag of k=restriction and v=no_right_turn. the expected output should be as following appreciate you help and/or explanation.
I would like to change the name of the folder that is in the datadownload zip to something else than dataset. Is this possible?My flow:I tried giving this option a parameter value from $(exportname). Defined as: When exporting it from the server with data download it gets ignored and only uses the default value.When using the job submitter it does not:It is possible to change the name but it looks like it only accepts the default value and not the incoming parameter that i use in my self made function. I checked at the beginning of the log and the workflow receives the correct value but does not use it with the data download and only uses the default.Is there another way that i can use to manipulate the name of the folder in the zip when using the data download service?
So I'm having a bit of an issue using the fme postgis reader/writer combo. I have a big model that works perfectly using shapefiles (with some adaptations) or using esri gdb. The thing is that I'm trying to only use postgis as entry files and output files. The entry files arepolylines and the output files are polygons. The issue is with the ouput. The input of polylines from postgis seams to affect the ouput.1. Shapefile reader: No problem2. .gdb reader: No problem3. postgis reader: polygons are converted to polylinesA few things to note: 1. When using the postgis reader I can still write the polygons in a shapefile2. When using a shapefile or a gdb as input I can write the polygons in postgis format.The issue to me seems that the spatial column is carried out from the entry data and I don't know how to get it to a blank slate. Sorry for my bad english.
Hello, is there a way (and how) to write block inside a block in AutoCAD Writer? Cheers, Zelimir
I have used excel reader with “Read hyperlinks” option in FME 2018.1.0.0 Build 18520 version. When I have prepared workspace, I used name of the excel file as FileName.xlsx. Later, when I’m running in batch using workspace runner, I have passed FileName_PRAT.xlsx. I have just renamed the file.Surprisingly, I observed that the attributes which are mapped from .hyperlink where dropped and migrated with <Null> values.When I opened workspace individually and checked whether “Read hyperlinks” option is checked or not, it is NOT-CHECKED but when I checked in backup workspace, it is CHECKED. If I passed with another file name even in individual workspace, FME is dropping the Read hyperlinks option. Is it happening for everyone???
I can get the inverts of the pipes in the pipe features, but i need the data to populate with my structure feature and when looking at the format attribute table for structures I don't see those attributes available
i have esri enterprise geodatabase (10.2.2) on mssql server 2012 and want to migrate to postgis(postgreSQL).i get the following error:Bulk copy failed on table 'table name' using delimiter ':' error was ERROR: column has Z dimension but geometry doesnot CONTEXT: can anyone please how i can solve this issue. thanks in advance.