Using readers and writers to extract and load data.
Recently active
I am trying to download from the Norweigan Surveys Inspire Atom feed using the latest version of the GeoRSS/RSS Feed [Reader]. Oddly the LinkURI does not get exposed by the reader. Looking at the XML source the links are present and are tagged <link></link> but for some reason they do not get interpreted correctly. Any ideas on how to solve this?Link to the feed: https://nedlasting.geonorge.no/geonorge/Tjenestefeed.xml
I’ve seen a few other posts discussing this or similar issues when it comes to writing data to tables in an Excel file, which is now affecting me on a current project. There is a similar problem in named ranges as well, although slightly less problematic. I went ahead and filed a support ticket but in the meantime, decided to post here in case someone knows of a solution.Every time data is written to tables and/or named ranges and a template file is used, the resulting file contains errors that Excel tries to fix upon opening the resulting file. If tables are involved and cells are referenced elsewhere, links to the first table end up broken as you can see below:Here is the resulting error upon opening the Excel file: Data seems to be written as expected, but having to click through an error when opening the Excel file, plus the potential of losing links to table data, is not a good thing. An example workspace template is attached so you can play around and test on your end (in version
I use Fme Form 2024.2.2. If I remember correctly, I used to convert multiple files in one process with an earlier versjon of Fme Form.I have attached a file showing how I structured the fmw for to separate files and for multiple files.I need to convert more than 100 files from Quadri format used in Norway to the GDB format.When I convert two files separately, everything is OK.The sise of gdb files are: Rp2 5,90 MbKdp3 2,62 MBBut when I convert to files in one process something is going wrong. The size of files are:Rp2 – 5,90 MBKdp3 – 154 kBI have tried different combinations of the order of files and numbers of files.It seems to me the first file is always Ok, but it fails from the second one onward.I appreciate all kind of helpEla
HelloHere’s my challenge:I have two datasets that I need to compare after several transformations.- Dataset 1: This contains georeferenced points with distances associated with a linear reference system (LRS).- Dataset 2: This has no geometry, but contains distances from the same LRS.My aim is to associate each value km_start in dataset 2 with the closest value _measures in dataset 1, even if they don't match exactly (I’d like to be able to assigne a tolerance, for ex. max difference of 0.01m). Thanks to this matching, I will be able to assign a geometry to the data in the second set. Below are a few screenshots to illustrate my question: Dataset1 with georeferenced points, _measures are distances in the LRSDataset2 with non geometry features I want to get the closest match from Dataset1 We're talking about fairly important datasets but it shouldn't be too much of a problem if the process takes time.Thank you in advance for your help and ideas.
Hi FME world,I have received a series of NetCDF files (representing rain radar) and I have no information on the projection for them, other than they are supposed to be in New Zealand and maybe Lambert Conformal? I can represent in an app like Panoply (image below) but when I try to project in FME, NZTM or LL84 is incorrect. I have tried creating a custom coordinate system but this is no use either. I’ve included a view of the Feature Information with the exposed list as per this conversation NetCDF - no CRS desposited | Community.Would love some direction if anyone has any thoughts?! Thanks!
I suspect this might be an ESRI thing rather than an FME thing, but is it expected behaviour that if a feature is written to a table which has a non-nullable long field that field gets populated as zero if an attribute is missing? No error, or warning?
i use pyrhon create FMETriangleStrip, how i add normal list for FMETriangleStrip? thanks
I have a workspace where the user should be able to export a DEM grid in several different fileformats (a user parameter for the output filetype). Then I have a FeatureWriter for the output. It works well if I want to output a raster DEM (e.g. a GeoTIFF), but if I want to output the data as a DWG with a point grid, I get several thousands of Features exported.Of course, I could make a workspace with a lot of different filetype Writers instead, but a single Feature Writer would be nicer. Is there a way to consolidate all the thousands of DWG points into one DWG? I dont really want a DEM consisting of one multipoint either.
Hi,I’m trying to use the OGC WFS FeatureReader to read in features based on a dynamic URL stored as an attribute. This is because in the URL link, I want to have a bounding box parameter that changes based on the extent of another dataset. I.e., I only want to read in the features that are within the bounding box of another dataset.I’ve set up an attribute “URL” that contains the bounding box parameter.When I hard-code in the URL with the bounding box parameter into the FeatureReader, it works as expected and reads in only the features within the bounding box. If I replace the URL with the dynamic “URL” attribute, it ignores the bbox parameter and reads in everything. I And yes, I’ve confirmed that the dynamic URL attribute is exactly the same as what I’ve hard-coded into the FeatureReader that works. Does anyone have any idea how I can fix this? Or any other ways I can read OGC WFS features with a dynamic bounding box?I’ve tried the Spatial Filter parameter in the FeatureReader too a
Hi all. I am reading in an Excel sheet where DateTimeUTC is formatted like this as text, but I need to convert this into a proper datetime for UTC… thoughts? DateTimeConverter is out, or perhaps I’ve not formatted it correctly. Otherwise, I can use attribute splitter to get the date, but the time part is tricky… not sure what to use to get that formatted properly
Hi, I’m an FME newbie. I have an ArcGIS sde (SQL) feature class of rooms with about 15000 rows across several hundred buildings. I need to write a list of rooms, by floor to directories for each floor in Google Sheets. I’m not sure how to go about generating each list. I’ve messed around with list builder some, but I’m stuck. I could do this in Python, but I’d like to take advantage of the FME Google Sheets writer.
Hi all. I’m trying to generate UIDs for helping out with site inspection reports for structures. The structures are comprised of “Components” and each “Component” is comprised of “Sub-Components”. Each “Sub-Component” has a inspection lists (“Lists”) that are checkboxes that need to occur for each “Sub-Component”. Each checkbox is a coded item (“Code”) that must be inspected. There are multiple “Codes” for each of the “Lists”.The UID format that is desired is this:“Site ID”. “Component ID” . “Sub-Component ID” . “Code”The problem I am running into is that the data have been provided in Excel. There is a “SiteVisits” Tab, and a “Lists” tab. The SiteVisits tab has 350+ records, with columns containing Site IDs, Component IDs and Sub-Component IDs, and a column on the “Lists” required for each Site.SiteVisits Tab, with 350+ recordsThe “Lists” Tab contains a descriptor of each checkbox and the associated “Code”. What I am trying to do is concatenate the easy parts of the UID (“Site ID”. “C
HI, I have a problem to solve where I need to extract the coordinate system within the header information of the ECW image (not the sidecar files). Our internal systems only work when the ECW header has “EPSG:7855” as the coordinate system, and I need to identify images that sometimes possess “GDA2020” & “Zone 55” information (as shown below). The software “ECW Header Editor” can distinguish between the two, but FME seems to use the two values interchangeably, so my workbench can’t identify potentially problematic images. The FME output for both “EPSG:7855” and the below entries are always “MGA2020-55_FME”. Is there any way for FME to identify the below values hidden inside an ECW header?
Hi,I am not able to use the ESRI GDB reader, as I am not able to open a layer from my database.So I created a reader reading a layer from GDB and then later this layer was removed from GDB, now I am not able to use the GDB reader at all, even if I open a new workbench and press the three dots button in the parameters of the reader, used to select the “Tables” , it gives me a message “Failed to retrieve feature types” “Layer not found”, but the layer mentioned in the error message is the old layer which is already removed from the GDB. And i didnt even got a chance to select a layer. What to do? Please do help.
hello,3dtiles writer support front and back texture? How can I achieve it?
I am outputting many rows to an excel table, some of my columns are numeric, I am hoping to add a total row at the bottom of my table, to sum these columns. I have found the Statistics Calculator, but I have no idea how to apply it (if at all possible). Any thoughts?
Hi All,I have read a few posts on the community already but can’t understand why the area calculated using Area Calculator is different to the SHAPE_Area in the Feature Class after exported to a GDB.An example below:Any ideas why does this happen?Thanks :)
This is probably a simple question, but I'm having difficulty rounding values within the xml editor of the XMLTemplator.With the root template set to:<feature> <number>{fme:get-attribute("NUMBER")}</number></feature>The NUMBER value is written in the output. But when I use:<feature> <number>@round({fme:get-attribute("NUMBER")},3)</number></feature>or even:<feature> <number>@Evaluate(@round({fme:get-attribute("NUMBER")},3))</number></feature>the xml returned contains an empty string:<?xml version="1.0" encoding="UTF-8"?><feature> <number/></feature>I could round with an AttributeRounder prior to the XMLTemplater, but although that rounds the values in Visual Preview, the xml output can and does contain the floating point representation errors.I'm guessing this might be a syntax thing but I've had no joy yet implementing this in the editor.(FME 2020.1 b20620)
Hi, I have a Civil 3D CAD model and need to extract information from the Drawing Settings. However, the available data comes from the Drawing Units window instead, which can be very different from what’s in the Drawing Settings
Hi,Could anyone please guide me on how to preserve the domain as it is when a feature class with domain for multiple fields is read using SDE reader, and then when it is written to a SDE Writer.When i look at the fields of the output feature class, the domain is empty. How can i overcome this?
Hello,So I have been trying to INSERT a ‘0’ value date using a FeatureWriter with MariaDB/MySQL compatible format into our MySQL DB, but I can’t seem to be able to do it. I keep getting the message the row is skipped because an “Invalid date/time value”.I have tried using many different values for the ‘0’ date like ‘0000-00-00’ , ‘00000000’ with and without the single quotes but I keep getting the same behavior. I’ve also tried using different types of fields (varchar, date, datetime) in FME (but always keeping datetime in the DB) and still the same.I tried using 00010101 and that one was accepted and it did actually loaded into the DB without problems. In the DB the field is Nullable and also accepts cero values, but I can’t seem to get it to work from FME.Any ideas?.Thanks in advance.RZ.-
Hi All,I am attempting to walk an FME script (using desktop 32 bit) over a large folder of specialised access databases called gINT files (.gpj) and move the data to various CSVs. However it will terminate after several hours with "MDB_ADO reader: An unknown exception occurred", and only write several of the CSVs for the files it has read. It works for smaller sample sets, so I don't believe it is a flaw in the script.I have a copy of the log, unfortunately it is a bit large to attach. Any help appreciated.Thanks-Jack Collins
I need help to make like something called monitoring directory.I have folder, its network based folder, and using FME form or FME Flow or both, i need to make next: Users will add CSV files in that folder, then that file or files will be add in postgreSql database.When users change file, it need to be changed in database too.When users add file , if the file with that name already exists in database , it needs to be replaced with new one
Hello, i am working on project and i need help.I want to copy multiple csv files from my pc, to postgreSql database.I have a folder on my computer and i want all files from that folder just to copy on postgre.I dont know how many files will be in folder on pc, so i cannot predict, but they all have some column names sames, some diferent, and some of them even have diferent number of columns So basically, i have set up a reader in FME workbench, in reader i selected which folder i want to read all csv files from, then reader is connected to schemaValidator , and that is connected on writer, that wrriter should write in postgresqlMy problem is that, when i run that workspace , in my postgre database writer writes right names in right schema with right data, but with columns from all files I need help, what can i do that if its exactly 5 files in folder that i read , that all 5 files in exactly how they are in folder to be copied on postgresql ? I have been try transformer FileCopy,
Hi all!I am relatively new to FME but I work with ArcGis Pro since a while now.I am trying to add an “Esri ArcGIS Server Feature Service” reader, which actually contains multiple map servers hosted online on the open government website (public data). When I try to add the reader in FME, I get absolutely no visual preview of the data, it does not open in my window and therefore cannot interact with the data. Even though I get multiple warning messages, my translation log seems to indicate that mapping file generation was successful…Can anyone help me? Has anyone already dealt with that kind of issue? Is it an issue with authentification and authorization?Do you have pertinent resources concerning ArcGis features services as reader in FME? Thank you!