Using readers and writers to extract and load data.
Recently active
Hi,It’s been several times I can’t achive to do this, but I’m sure there is a way.I have the following table :And I want to get the following result : The thing is : I don’t know in advance what will be the name of IndA and IndB (and there can be more than 2 values, so more than 2 columns in the result table). I achieved to get my result table with an inlineQuerier, but I need to enter a fixed value for the Indicateur values.select "Zone", max(CASE WHEN "Indicateur"='IndA' THEN Valeur ELSE 0 END) as 'IndA', max(CASE WHEN "Indicateur"='IndB' THEN Valeur ELSE 0 END) as 'IndB'from "Input"GROUP BY "Zone" Any idea ?
I am currently trying to migrate my Geometric Network (GN) system data to the Utility Network (UN) and would like to include attachments in the FME workbench. Currently, I have a workbench that successfully migrates the points, lines and polygons (Assets, domains, and attributes) to target UN features but I am not sure how to handle attachments. Should attachments be handled in a separate bench?The attachments would be mapped from the source tables to the new UN attachment tables. For example, hydrant attachment table would be migrated to Device attachment tableCan attachments be migrated using FME? What type of transformers and workflow needs to be utilized to move this type of data?
I have set up a dynamic workbech with the follwoing setup. Its from SQL Server to geopackage. It has been working fine daily for months until today when i noticed one record was missing geometry (geometry was null in the target geopackage databse). Why does this single record fail to write? Checking the geometry types in the source database (STGeometryType ( ) ) for the feature type they areGeometryCollection LineStringI dont understand why it is failing when I am using a dynamic workflow in the first place?Where should i start to look for errors, is there anything i can do? I have been poking around for a long time to try to make sense of it. One thing i have found is if i look at the feature with the Feature information window there is a “fme_geometry” attribute with a value of fme_aggregate. The attribute fme_type is of fme_collection.The failing feature is the only one whch is a fme_aggregate, so i am assuming that has something to do with the problem? But why would it be an issue
I'm reading in ECW file to get the Filename, X Y Min, X Y Max. Write to excel, I do not want the image/raster in my excel file.How do I get rid of the image?
I have an ETL workbench and would like to create a text file where I can write some information while running the workbench. The information I would like to write includes:The path to individual readers The feature counts of each reader The coordinate system of the each reader How many objects have been written to the databaseI don't want to use logging per se because it writes basically all information.What alternatives do I have? Can I only do it with python`?
I have a Microsoft SQL Server database and need to mirror/copy some tablez to another Microsoft SQL Server.For most attributes it is working, but not for numeric(width, precision) values it is not. The numbers after the decimal do not show in the new database. This might has to do with the decimal / language setting; I am not sure what the problem is. I read about the use of 'native_data_type'https://docs.safe.com/fme/html/FME-Form-Documentation/FME-Form/Workbench/Deriving-Destination-Schema-from-Schema-Feature.htm'To instruct the dynamic writer to apply the native_data_type to the schema feature, instead of the fme_data_type, specify attribute fme_format_short_name and set the value to the Format Type Identifier ("short name") of the format. For example, fme_format_short_name = “GEODATABASE_FILE”.'But do not know how to implement this. Where do I need to put this 'fme_format_short_name'?Hope someone can provide some insights.ThanksStefan
DATA analysis of different types data to map.Here below is all of data related work that I have finished!https://www.gnvcompitservices.com/gis
Hello FME enthusiast, I exported a data from SW to SHP using FME workbench and after exported i used FME inspector to view exported shp file which don’t have geometry. but when i open same shp file in QGIS which showing geometry as MultiPoint. But in writer (Shp) mentioned shape_file point not multipoint. Does anyone come across this case ?.Thanks in Advance!
Hey all, I often receive multiple AutoCAD drawings which I need to convert to ArcGIS feature classes. I configured my reader as 'Single Merged Feature Type' to read all the features in one input port. At the end of my workflow I want to save the features by dividing them over the feature classes of the unique combination of autocad file name (fme_basename) and GIS geometry type. I tried to use the geometryfilter to filter on point, line & polygon features followed by a string concatenator to then create a new attribute that contains the combination of fme_basename and geometry (point, line, polygon). I then tried to use a fanout by setting the feature class or table name in the writer to the created attribute and ticked the dynamic schema option and set the fme_feature_type as schema definition name. The result is however not completely what I wanted because I end up with for example different feature classes for arcs and lines while in arcgis these are both considered lines. Exam
Hi everyone!Curious if I could pick your brains on how to achieve the workflow:I am connecting to an asset via API as well as another separate GIS Feature Class in an EGDB. The workflow will start with a user editing the GIS Feature Class. When a user updates or creates a new record in the GIS Feature Class, I am pulling it into the Change Detector, and wanting to write to the API table only if the asset_id does not exist in the API table. The asset_id field in the GIS FC = unitid in the API Table, as the field has a different name than the same column has in the GIS Feature class.Here is how my workspace is looking now, with the top line connecting to my API as the original source in the Change Detector, and my GIS FC as the Revised source in the Change Detector. That’s one of the main prediciments here is that the data schemas are different as the original source is a Hansen API table whereby the fields have different schemas/naming conventions than the fields in the GIS FC (by desi
Hi All, I’m having a bit of headache to get my worflow working: I need to load some attribute data into a template GDB but for some reason fails becuase of the data type (I asume). Below some screenshots that explains the issue:ErrorValue 4510069419 can’t be written into table UPRN_Lookup_Monthyear_FulSupply Raw data valueFME reads value UPRN as unit64 data type see below: Template GDB in FMEFME reads the template GDB (in the FeatureWriter transformer) as Float Template GDB in ArcCatalogUPRN value is Float in the GDB template What value can’t be written?Thanks
The last few weeks I have been getting an error message whenever I try to frequently run my workspaces. Since I am testing transformers, and attempting to find the ones that create the most appropriate outputs for my task, which is converting a shapefile to match with a preset schema. If I run the full workbench and then change something because the output did not match what I needed, then run the workbench again. I get an error that says “Failed to write to file” with the file path pointing towards a .dbf filetype in my output folder. The only fix at the moment is completely closing FME and reopening. But doing this for every small iteration is not feasible long term.
Hi All,For a project I need to write a geodatabase with a time_only field in one of the objects.To be able to do this I had to change my Python Compatibility to Python 3.9, which only works if Arcgis Pro 3.2 is installed.Otherwise I get this very helpfull error:But I don’t want to use 3.2 as default. Now I have 2 folders:C:\Program Files\ArcGIS\Pro2_9C:\Program Files\ArcGIS\Pro3_2I manually renamed the Pro folder to include the version number.The issue now is that FME can’t find my Arcgis Pro, which makes me very sad 😥. How can I tell FME to just use C:\Program Files\ArcGIS\Pro2_9 and stop looking for C:\Program Files\ArcGIS\Pro.Only when I want, I manually will change the folder to 3_2.
I have dgn/dxf formatted CAD 3D lines which are "cables" below the ground. These cables are sometimes 1m below ground and sometimes 50cm and 10cm etc. below the ground. I have pointcloud LAS data as ground elevation data.Now I want to extract the cables(lines) which are below the ground upto 50cm. I want to cut the cables layer with elevation model to selct the cables network from 0 to 50 cm below the ground.How can I cut those lines? I am trying with qgis and FME but, unable to get the right solution. Anyone has idea what software or methods to follow.
HI All,What the best way of loading data into a blank template GDB? Attributes, domains, etc are already set up in the template GDB but need to know how to load data into the template using FME,Do I need to use the template GDB in the writer and then map the fields from the reader to the writer?Any idea how to do this?Thanks
In FME Form 2024.0.1.0 I got an error when trying to read data or schema with “Microsoft SQL Server Non-Spatial” Reader: “Unable to decrypt data”. On the same server, connection with SQL Server Management Studio works fine.Does anybody know this problem or has a solution?Regards, Martin
HelloI have several GDBs with several FCs in different subdirectories. However, all GDBs have the same structure (same FC with identical attributes). I would like to merge all the data depending on the FC and then process it further in an existing workflow. Using the example, I was able to read and save all data, but it deleted all attributes and combined all FCs into one single FC. My question now is how I could read all FCs with the same name from all GDBs, merge them in one FC and then process them further in an existing workflow.
I simply need to update a geometry column in a SQL Server table that is previously set to NULL. Could someone provide me with a simple example? I can't do it neither with a SQL Executor (previously using a GeometryExtractor to convert this geometry in Microsoft SQL Server Binary) nor with a featureWriter. I found this conversation from a while back but it didn't help me: Thank you!
Good eveningI produce a worbench wich create a file gdb and different features class (table, polyligne, polygon) from a excel file wich describe :fme_feature_type_name fme_feature_type_alias name alias fme_data_type geometry native_data_typeIs it possible in the same excel file :to create domain value (domain code and domain describe) to apply Global Id to apply editor trackor Thank you
Hey all, I am very new to FME and this may be a basic question, But I currently can’t find the answer elsewhere so I figured I would post and see if anyone can point me in the right direction. Currently, I am exporting from a GE small world database and moving the data to a FGDB for data analytics in other software. This is a complete export of all available data. That much I have been able to figure out with a few minor transformations. What I can’t yet figure out is how do I export only a small portion of the database. Say by a predefined polygon within the existing data set. For example My DB crosses a number of contiguous cities all having a defined boundary within the drawing. How do I tell FME to select and export only the lines and other objects within the city boundary of interest and excluded the data within the other city boundaries? Ultimately I need this breakdown so I Can export this to AutoCAD since the full DB is entirely too large for one drawing. Any help is apprec
HelloI find this workbench on this website and i try to use it with FME 2024. It doesn’t work with the new version and i would like to know what is the issue. Could you please explain ?Thanks a lot
Hi,I'm working with Sentinel-2 images. I would like to know if it's possible to use FME to remove or clip clouds from images. Does anyone have any ideas? Is it possible to use Google Earth Engine (GEE) with FME?Thank you.
Hello, GML always writes a hyperlink at the beginning of the output, how can I fix this?
I have a lot of excel spreadsheets that all have the same attribute schema. However, there are a varying number of header lines that precede the data in each. In FeatureReaders & Readers, we define the start point for data by line number. Given the consistency of the attribute schema and the inconsistency of the header spiel, I’m trying to think of a way to only read in the ssheets from the start of the data/attribute names, i.e. dynamically, defined by the first attribute name rather than the line number (I guess). Any ideas?