Using readers and writers to extract and load data.
Recently active
I’m trying to upload a raster to Mapbox, but no matter what I do, the output file always turns the nodata cells to black. I have tried fixing this using RasterBandNodataSetter and RasterPaletteResolver. If I look at the feature cached output from those transformers the nodata cells are still transparent. The issue arises when I use the MBTILES writer. No matter what, it writes nodata as black. I also tried removing the nodata (RasterBandNodataRemover), doesn’t work. I have tried outputting the data both as png, png8, and jpeg. Does anyone have any other suggestions? Thank you in advance!
When using a FeatureReader transformer to read Snowflake spatial data, the following warning is posted into the log.Snowflake Spatial Reader: Skipping data in column '.GEOG' due to error (JDBC Type = VARCHAR, Vendor Type Name = GEOGRAPHY, Error: class java.lang.String cannot be cast to class [B (java.lang.String and [B are in module java.base of loader 'bootstrap'))The process does complete normally, but the geometry is not read automatically. Has anyone else encountered a problem like this? I’m using FME Form 2024.0.1.0, Build 24202.
Hi, I have scanned a map and saved it as a raster image. I need to compress this PDF using FME. I have tried RasterMappers and RasterResampler, but both are making my map smaller without actually reducing the file size. Do you have any recommendations, please?
Hi,A colleague and I are working on a script for a client. In the script, we have a simple custom transformer that performs a loop to match some attributes in the correct order. Its basically just a feature merger with a loop: If I run the entire workspace the loops get stuck and keep iterating forever. However if we run the workspace with for example "run to this" far down the stream, it has no problem and the custom transformer finishes after a few seconds.Does anyone have a clue why this is happening and what we could do to prevent it?Best regards
Hi FME Community,I have a folder containing 100 CityJSON files, each with three main features: Building, BuildingPart, and Metadata.I need my files to be dynamically processed by transformers to create new attributes and then output the modified CityJSON files into a new folder while keeping the original filenames.Do you have any tips on how to achieve this?Best regards,ImanePS: I tried using the reader to specify the folder path, but it doesn’t seem to be working perfectly.
I am trying to download from the Norweigan Surveys Inspire Atom feed using the latest version of the GeoRSS/RSS Feed [Reader]. Oddly the LinkURI does not get exposed by the reader. Looking at the XML source the links are present and are tagged <link></link> but for some reason they do not get interpreted correctly. Any ideas on how to solve this?Link to the feed: https://nedlasting.geonorge.no/geonorge/Tjenestefeed.xml
I’ve seen a few other posts discussing this or similar issues when it comes to writing data to tables in an Excel file, which is now affecting me on a current project. There is a similar problem in named ranges as well, although slightly less problematic. I went ahead and filed a support ticket but in the meantime, decided to post here in case someone knows of a solution.Every time data is written to tables and/or named ranges and a template file is used, the resulting file contains errors that Excel tries to fix upon opening the resulting file. If tables are involved and cells are referenced elsewhere, links to the first table end up broken as you can see below:Here is the resulting error upon opening the Excel file: Data seems to be written as expected, but having to click through an error when opening the Excel file, plus the potential of losing links to table data, is not a good thing. An example workspace template is attached so you can play around and test on your end (in version
I use Fme Form 2024.2.2. If I remember correctly, I used to convert multiple files in one process with an earlier versjon of Fme Form.I have attached a file showing how I structured the fmw for to separate files and for multiple files.I need to convert more than 100 files from Quadri format used in Norway to the GDB format.When I convert two files separately, everything is OK.The sise of gdb files are: Rp2 5,90 MbKdp3 2,62 MBBut when I convert to files in one process something is going wrong. The size of files are:Rp2 – 5,90 MBKdp3 – 154 kBI have tried different combinations of the order of files and numbers of files.It seems to me the first file is always Ok, but it fails from the second one onward.I appreciate all kind of helpEla
HelloHere’s my challenge:I have two datasets that I need to compare after several transformations.- Dataset 1: This contains georeferenced points with distances associated with a linear reference system (LRS).- Dataset 2: This has no geometry, but contains distances from the same LRS.My aim is to associate each value km_start in dataset 2 with the closest value _measures in dataset 1, even if they don't match exactly (I’d like to be able to assigne a tolerance, for ex. max difference of 0.01m). Thanks to this matching, I will be able to assign a geometry to the data in the second set. Below are a few screenshots to illustrate my question: Dataset1 with georeferenced points, _measures are distances in the LRSDataset2 with non geometry features I want to get the closest match from Dataset1 We're talking about fairly important datasets but it shouldn't be too much of a problem if the process takes time.Thank you in advance for your help and ideas.
Hi FME world,I have received a series of NetCDF files (representing rain radar) and I have no information on the projection for them, other than they are supposed to be in New Zealand and maybe Lambert Conformal? I can represent in an app like Panoply (image below) but when I try to project in FME, NZTM or LL84 is incorrect. I have tried creating a custom coordinate system but this is no use either. I’ve included a view of the Feature Information with the exposed list as per this conversation NetCDF - no CRS desposited | Community.Would love some direction if anyone has any thoughts?! Thanks!
I suspect this might be an ESRI thing rather than an FME thing, but is it expected behaviour that if a feature is written to a table which has a non-nullable long field that field gets populated as zero if an attribute is missing? No error, or warning?
i use pyrhon create FMETriangleStrip, how i add normal list for FMETriangleStrip? thanks
I have a workspace where the user should be able to export a DEM grid in several different fileformats (a user parameter for the output filetype). Then I have a FeatureWriter for the output. It works well if I want to output a raster DEM (e.g. a GeoTIFF), but if I want to output the data as a DWG with a point grid, I get several thousands of Features exported.Of course, I could make a workspace with a lot of different filetype Writers instead, but a single Feature Writer would be nicer. Is there a way to consolidate all the thousands of DWG points into one DWG? I dont really want a DEM consisting of one multipoint either.
Hi,I’m trying to use the OGC WFS FeatureReader to read in features based on a dynamic URL stored as an attribute. This is because in the URL link, I want to have a bounding box parameter that changes based on the extent of another dataset. I.e., I only want to read in the features that are within the bounding box of another dataset.I’ve set up an attribute “URL” that contains the bounding box parameter.When I hard-code in the URL with the bounding box parameter into the FeatureReader, it works as expected and reads in only the features within the bounding box. If I replace the URL with the dynamic “URL” attribute, it ignores the bbox parameter and reads in everything. I And yes, I’ve confirmed that the dynamic URL attribute is exactly the same as what I’ve hard-coded into the FeatureReader that works. Does anyone have any idea how I can fix this? Or any other ways I can read OGC WFS features with a dynamic bounding box?I’ve tried the Spatial Filter parameter in the FeatureReader too a
Hi all. I am reading in an Excel sheet where DateTimeUTC is formatted like this as text, but I need to convert this into a proper datetime for UTC… thoughts? DateTimeConverter is out, or perhaps I’ve not formatted it correctly. Otherwise, I can use attribute splitter to get the date, but the time part is tricky… not sure what to use to get that formatted properly
Hi, I’m an FME newbie. I have an ArcGIS sde (SQL) feature class of rooms with about 15000 rows across several hundred buildings. I need to write a list of rooms, by floor to directories for each floor in Google Sheets. I’m not sure how to go about generating each list. I’ve messed around with list builder some, but I’m stuck. I could do this in Python, but I’d like to take advantage of the FME Google Sheets writer.
Hi all. I’m trying to generate UIDs for helping out with site inspection reports for structures. The structures are comprised of “Components” and each “Component” is comprised of “Sub-Components”. Each “Sub-Component” has a inspection lists (“Lists”) that are checkboxes that need to occur for each “Sub-Component”. Each checkbox is a coded item (“Code”) that must be inspected. There are multiple “Codes” for each of the “Lists”.The UID format that is desired is this:“Site ID”. “Component ID” . “Sub-Component ID” . “Code”The problem I am running into is that the data have been provided in Excel. There is a “SiteVisits” Tab, and a “Lists” tab. The SiteVisits tab has 350+ records, with columns containing Site IDs, Component IDs and Sub-Component IDs, and a column on the “Lists” required for each Site.SiteVisits Tab, with 350+ recordsThe “Lists” Tab contains a descriptor of each checkbox and the associated “Code”. What I am trying to do is concatenate the easy parts of the UID (“Site ID”. “C
HI, I have a problem to solve where I need to extract the coordinate system within the header information of the ECW image (not the sidecar files). Our internal systems only work when the ECW header has “EPSG:7855” as the coordinate system, and I need to identify images that sometimes possess “GDA2020” & “Zone 55” information (as shown below). The software “ECW Header Editor” can distinguish between the two, but FME seems to use the two values interchangeably, so my workbench can’t identify potentially problematic images. The FME output for both “EPSG:7855” and the below entries are always “MGA2020-55_FME”. Is there any way for FME to identify the below values hidden inside an ECW header?
Hi,I am not able to use the ESRI GDB reader, as I am not able to open a layer from my database.So I created a reader reading a layer from GDB and then later this layer was removed from GDB, now I am not able to use the GDB reader at all, even if I open a new workbench and press the three dots button in the parameters of the reader, used to select the “Tables” , it gives me a message “Failed to retrieve feature types” “Layer not found”, but the layer mentioned in the error message is the old layer which is already removed from the GDB. And i didnt even got a chance to select a layer. What to do? Please do help.
hello,3dtiles writer support front and back texture? How can I achieve it?
I am outputting many rows to an excel table, some of my columns are numeric, I am hoping to add a total row at the bottom of my table, to sum these columns. I have found the Statistics Calculator, but I have no idea how to apply it (if at all possible). Any thoughts?
Hi All,I have read a few posts on the community already but can’t understand why the area calculated using Area Calculator is different to the SHAPE_Area in the Feature Class after exported to a GDB.An example below:Any ideas why does this happen?Thanks :)
This is probably a simple question, but I'm having difficulty rounding values within the xml editor of the XMLTemplator.With the root template set to:<feature> <number>{fme:get-attribute("NUMBER")}</number></feature>The NUMBER value is written in the output. But when I use:<feature> <number>@round({fme:get-attribute("NUMBER")},3)</number></feature>or even:<feature> <number>@Evaluate(@round({fme:get-attribute("NUMBER")},3))</number></feature>the xml returned contains an empty string:<?xml version="1.0" encoding="UTF-8"?><feature> <number/></feature>I could round with an AttributeRounder prior to the XMLTemplater, but although that rounds the values in Visual Preview, the xml output can and does contain the floating point representation errors.I'm guessing this might be a syntax thing but I've had no joy yet implementing this in the editor.(FME 2020.1 b20620)
Hi, I have a Civil 3D CAD model and need to extract information from the Drawing Settings. However, the available data comes from the Drawing Units window instead, which can be very different from what’s in the Drawing Settings
Hi,Could anyone please guide me on how to preserve the domain as it is when a feature class with domain for multiple fields is read using SDE reader, and then when it is written to a SDE Writer.When i look at the fields of the output feature class, the domain is empty. How can i overcome this?