Using readers and writers to extract and load data.
Recently active
Hello,So I have been trying to INSERT a ‘0’ value date using a FeatureWriter with MariaDB/MySQL compatible format into our MySQL DB, but I can’t seem to be able to do it. I keep getting the message the row is skipped because an “Invalid date/time value”.I have tried using many different values for the ‘0’ date like ‘0000-00-00’ , ‘00000000’ with and without the single quotes but I keep getting the same behavior. I’ve also tried using different types of fields (varchar, date, datetime) in FME (but always keeping datetime in the DB) and still the same.I tried using 00010101 and that one was accepted and it did actually loaded into the DB without problems. In the DB the field is Nullable and also accepts cero values, but I can’t seem to get it to work from FME.Any ideas?.Thanks in advance.RZ.-
Hi All,I am attempting to walk an FME script (using desktop 32 bit) over a large folder of specialised access databases called gINT files (.gpj) and move the data to various CSVs. However it will terminate after several hours with "MDB_ADO reader: An unknown exception occurred", and only write several of the CSVs for the files it has read. It works for smaller sample sets, so I don't believe it is a flaw in the script.I have a copy of the log, unfortunately it is a bit large to attach. Any help appreciated.Thanks-Jack Collins
I need help to make like something called monitoring directory.I have folder, its network based folder, and using FME form or FME Flow or both, i need to make next: Users will add CSV files in that folder, then that file or files will be add in postgreSql database.When users change file, it need to be changed in database too.When users add file , if the file with that name already exists in database , it needs to be replaced with new one
Hello, i am working on project and i need help.I want to copy multiple csv files from my pc, to postgreSql database.I have a folder on my computer and i want all files from that folder just to copy on postgre.I dont know how many files will be in folder on pc, so i cannot predict, but they all have some column names sames, some diferent, and some of them even have diferent number of columns So basically, i have set up a reader in FME workbench, in reader i selected which folder i want to read all csv files from, then reader is connected to schemaValidator , and that is connected on writer, that wrriter should write in postgresqlMy problem is that, when i run that workspace , in my postgre database writer writes right names in right schema with right data, but with columns from all files I need help, what can i do that if its exactly 5 files in folder that i read , that all 5 files in exactly how they are in folder to be copied on postgresql ? I have been try transformer FileCopy,
Hi all!I am relatively new to FME but I work with ArcGis Pro since a while now.I am trying to add an “Esri ArcGIS Server Feature Service” reader, which actually contains multiple map servers hosted online on the open government website (public data). When I try to add the reader in FME, I get absolutely no visual preview of the data, it does not open in my window and therefore cannot interact with the data. Even though I get multiple warning messages, my translation log seems to indicate that mapping file generation was successful…Can anyone help me? Has anyone already dealt with that kind of issue? Is it an issue with authentification and authorization?Do you have pertinent resources concerning ArcGis features services as reader in FME? Thank you!
j'ai un fichier dgn contenant les câbles de type polyligne avec leurs extrémités. -je veux extraire les câbles et les convertire en shapefile (.shp) avec les noms des extrémités.???
I'm trying to extract DWG properties into FME, the equivalent of the DWGPROPS command in AutoCAD. I have added an example screenshot below. The aim is to use this information wthin a workbench on FME Server. I couldn't identify anything in the AutoCAD reader that shows these properties. Does anyone have any solutions that would expose these DWG properties in FME? Any help would be greatly appreciated!
Hi,I read sdo_geometry and make a cutout of a small area. I want to save this cutout as a jpf file. Is that possible?I do see jpg writers, but I suspect that some preparation needs to be done before you can save geometry data as jpg.
I'm trying to update an IFC file by assigning it a coordinate system. However, FME doesn't seem to recognize the coordinate system used by the IFC2x3 file.I understand that the IFC file operates with a local coordinate system, but I don’t have information on which specific system it uses.I've attempted the following approaches:CoordinateSystemSetter Reprojector Setting the Writer’s coordinate system to WGS84 UTM33Despite these efforts, the file always ends up with the coordinate system IFC_COORDSYS_0.Does anyone have a solution or a recommended approach to resolve this?
The Coordinate Systems Gallery is missing EPSG spatial references we use all the time. How to update the gallery list so that more EPSG codes are available? (e.g. anything on https://epsg.io/)
A user is supposed to use FME Server's web interface for running a FME workspace that has been published on it. That FME workspace takes a file geodatabase as input. The user should upload his/her file geodatabase at runtime in the web interface for that workspace. The problem is that the browser will not let the user select the folder defining the file geodatabase. Furthermore selecting all subfiles of that geodatabase will lead to a failed run. What is it that I am overlooking? Thanks in advance!
Hi allI have an FME Workbench file which has to do the following things:Ask for multiple directories via a published user parameter read two files in each directory which end in _changes.shp and _to_remove.shp AND are always located in a subfolder v1 in each directory.The transformers and writer after that are already doing what they should do, but I can’t seem to confgure my reader to do what I asked here. Is this even possible to do? And if so, how should I do this?Thanks in advance for the help!
Hello,I'm using FME form 2024 and I would like to know how to configure the software so that the Inspector automatically opens in a separate window after a translation is completed. I’m having trouble finding this option in the interface.Could someone please guide me through the steps to achieve this in FME 2024?
I am new bee and want to generate FME flow which reads every day file from SFTP server and populate the datathe first half of the file is default then their is date concatenation with “MMDDYYYY” format and then suffix with file extensioni use datetimestamper transformer and found the date but when pass that date to FeatureReader in Dataset with “default text”@Value(_Date) , it does not generate the fileCan someone help with if their is any example which can provide me guidance on how to set auto filenames
I have a field that contains values with parentheses, like (0601310951181134359628), and I would like to remove them. The parentheses always appear once at the beginning and once at the end of the field.I am currently able to achieve this using two StringReplacer transformers, each removing one parenthesis. However, I would like to do it in one step. I tried the recommended regex expressions from previous posts, but none of them worked.Any suggestions?
Hi all, I want to update certain attributes in a DWG block. To the left where it says "test" I have updated an attribute. However FME writes out duplicate blocks and the new one is also bigger than the original. Is there a way to update attributes and write the changes to a DWG without touching anything else? Thanks! /Jacob
I have tiff file that I have been provided when I run it through FME Workbench 2024.2 to create a mbtiles package, I get this strange black background, I assume it is the defulat tile for the area. The orginal tiff only occupies the extent of what you see in the map itself below. So the conversion is tacking on this huge black boundary. Any ideas on how I make it not do that? I have included a screen shot of my settings below. Thanks for any ideas!!
Hi,I am trying to prepare a PDF with the PDFPageFormatter. I have 6 input ports in the PDFPageFormatter and it seems impossible to align them exactly with each other. I have the same upper left x and -y for all 6, the same size. I selected them all and centered them with allign. but there is still one of the input ports that shifts slightly. How can you set this alignment correctly?The top part of the attachment is the Data Inspector. The bottom part is the PDF. The green areas have shifted.
I saw a very similar question to this from a couple of months ago where the poster managed to resolve it on his own, but his fix did not work in my case.I'm reading from AutoCAD Map OD (multiple files) and writing to AutoCAD Map OD (single file). I've checked my template file and Shape File Folder Path and they all seem to be fine, so I don't understand this error or why my workspace won't run.
I have hundreds of json file saved to one location, they have a structure as example below: [ { "json_featuretype" : "1da87ac9-2472-42da-a80f-cba37a36cce5", "path_directory_windows" : "C:\\Magda_H\\test\\", "uuid" : "1da87ac9-2472-42da-a80f-cba37a36cce5" }] I’d like to use PythonCaller to save them to location as state under: "path_directory_windows" : "C:\\Magda_H\\test\\". Can I please ask for the help with creating a python script to run this. Thank you
I found that Industry Foundation Classes (IFC) (Tech Preview) [IFC_API] Reader in FME 2024 cannot reader IfcOpeningElement features and non-subtracted wall, slab etc. features.In some cases it's essential to read IfcOpeningEelement features as simple solid geometries and non-subtracted features.It would be nice if the [IFC_API] reader would have parameters equivalent to the "Subtract Openging Geometries" parameter in the current Industry Foundation Class STEP/XML Files (IFC) reader.
hello , 👋 I'm working on finding the path for specific lines and reorder points .I have several lines, each defined by a start and end point, but these lines also contain intermediate points. Should I merge the intermediate points with the lines before using a shortest path finder, or how will the transformer know which intermediate points belong to each line if I don't provide them? My goal is to reorder all points, including the intermediate ones, to find the correct sequence from point A to the final point, such as A, B, C, D, E, F, G.
Is it possible to write an image from a jpeg url into a file geodatabase? In other words, I want to store images directly from a url into a geodatabase. I need to extract the image from the url and move that image into a geodatabase. Thank you!
How to securely achieve the desired order of in which are feature types (tables) written in the database? I have some FK dependecies in the target tables and I have somehow discovered that its written from the bottom to the top of the feature types list. If its not written from the parent to the childs it crashes on FK violations. I know there is an idea registered. But so far what are the options? It consider the inserts/updates and also deletes where i would need the inverse order.Thank you for the suggestions.