Using readers and writers to extract and load data.
Recently active
Hello,I have encountered a problem, and I hope someone can provide guidance. I need to extract segments of a gable roof. I have attached a picture that illustrates my input data, which consists of polygons indicating the gable roof among other roofs in a digital orthophoto.I have utilized the CenterLineReplacer tool, which yielded satisfactory outcomes in most cases. However, I am experiencing difficulties in situations depicted in the image below (the line should be in a different direction): Does anyone have any ideas on how to solve this?Thank you in advance for your assistance.
Hi FME people,When creating a reader or writer, our typical procedure involves selecting an SDE database connection, such as SDE.EDIT.R. Following this selection, we establish a link to a deployment parameter, assigning it a local value. In this scenario, the local value corresponds to the database connection SDE.EDIT.R. This works well, except when we try ‘view source data’ or ‘view written data. The connection is set to the deployment parameter but the local value is not used instead.Anyone who is experiencing the same thing? We use:FME Form: 2023.2.2FME Flow: 2023.2.2Thanks a lot,Francis
Hi all, I seem to be getting a strange error when trying to attach an image from a feature layer in AGOL to Cityworks using the HTTP caller. My goal is to download and upload each unique image from the AGOL feature layer and attach it to the correct Work Order (i.e. picture of stop sign for sign work order, picture of a pothole for a pothole worker). My workflows is as follows, read in the AGOL feature layer, save each image using the AttributeFileWritter, create the work order, attach the image using the HTTP Caller. The error occurs when I try to upload the image will using a variable name in the output PATH + .jpeg extension. When I explicitly set the image in the file upload, it runs no problem. However when I use the variable name in the path I get a “ HTTPCaller_2 (HTTPFactory): [11]: HTTP transfer error: HTTP/FTP Transfer: Failed to open file 'C:\Path\To\Documents\WorkOrder_Pictures\.jpeg' for resource upload”. Here is my Cityworks API callI write the image to a folder using a
Hello everyoneI hope someone can help me. I try to convert an INTERLIS (Switzerland specific dataformat) into a File-Geodatabase and got always the same error message: Could not create the File Geodatabase 'C:\Users\Documents\IBI INTERLIS\Test\ibi_saxeten.gdb'. A possible reason is that you may not have permission to create the Geodatabase. The error number from ArcObjects is: '-2147220902'. The error message from ArcObjects is: {} Could anyone explain to me what this error message means, because I have literally no idea what causes this problem. Thanks a lot and have a nice week :)
Hi All,Is there any way to read multiple GDBs saved on the company Sharepoint? Does the Sharepoint need to be publicly accessible? I get an error when try to use the URL link and load the GDB, Also I would like to know a workaround to read individual GDBs, Any Ideas? The GDBs are saved in individual folders so need to iterate thought these, example of the folder structure below: Example of the individual content folder below:
Hello FME Community,I'm currently working on a project that involves a large number of subdomains and domains, and I have my data available in table format. I'm looking for guidance on how to organize this data into a geodatabase (GDB) using FME, while adhering to domain conventions.Specifically, I would like to know:How can I create subdomains within a GDB using FME? What steps are involved in defining domains for attributes within the GDB? Are there any best practices or recommended workflows for organizing subdomains and domains efficiently?Any insights, tips, or examples would be greatly appreciated. Thank you in advance for your help!Best regards,Vishnu N V
I’m looking for a way to move points which are spaced at “x” distance from one another to a nearby road (line) shapefile. I want to maintain the same “x” spacing along the road once the points are moved to the line.
Hello everyone,I'm facing a challenge in processing data in Excel and I'm seeking assistance. I need a method to search in one Excel table for entries that contain values from another Excel table and then create a new table with the found entries.Specifically, I want to search an Excel table (Table A; 8 collumns) for certain keywords. These keywords are located in a separate Excel table (Table B; 1collumn). When any of the keywords are found in Table A, I'd like to create a new table with these entries.I would greatly appreciate any advice, tips, or examples that could help me solve this issue.Thank you very much in advance for your help!
Hello,I need some help.I am a major student and I am in my final paper for my diploma. I Have to make a 3D map of a town using Citygml.I have used Arcgis to create the shape file and pgadmin to create a data base.But when I try to connect my database to Citygml It doesn’t work.When I open the command line to insert the parameters it says that there is a problem.I have installed postgresql and Java in my computer.i don’t know if someone can help me but you are my last hope haha(Not an native English speaker so if something is not explained good please be understanding)
I am reading data from a PostGIS table and writing to an ArcGIS eSDE, but I’m not able to create tables in the eSDE from FME, I can only write to tables created by ArcGIS Pro in the eSDE, is this normal? I'm getting an ArcObjects error ‘-2147220655’, DBMS table not found.
Hi FME users, The main purpose of my recent FME workflow is to GET the files from the folder from the FME server using HTTPCaller. Although the process displayed green which means the process is running correctly, the inspector showed the HTTP status code 200, which means the results are rendered in the response body (Figure 1. ) but not created successfully in the local drive. Figure 2 is the basic setup in HTTPCaller. Figure 1. FME Inspector. Figure 2. HTTP Set-up Then, I tried another URL copied from FME API using POST, /fmerest/v3/resources/connections/Data/download/Logo/CPB_Logo.jpg, then the FME gave me the HTTP error code 403 FME Server is version 2023.2.1FME workbench is version 2021.2.3 Do you think it is because of the Version or some other issues? Thanks,Du
Hi, I'm reading around 5 million rows from the 252 Excel files. I need to view the rows to delete many columns and edit values, but indexing the results is taking a long timeHow can I improve this? Thank´s
I have an AttributeManager in a custom transformer (may be part of the problem but thought I would start simple with the AttributeManager) that has the following data (correct) on the input but the name of the attribute (not the attribute values) is assigned in the output.Input Attribute “Public_Water_System_ID” with correct values and output with wrong values:Settings in the AttributeManager is as follows:For data type I’ve tried buffer (default), varchar(20), and char(20). None of the other types seemed to make sense since the values are string.Perhaps a related problem is that this attribute (“Public_Water_System_ID”) is passed as a parameter into this custom transformer and is seems like there might be an issue with the transfer. However, that being said, the correct values are appearing at the input port of the AttributeManager which is downstream from the custom transformer input.
Wich versions FME desktop are compatible with pluggin Smallworld 4/5?
Hello, i’m triying to insert / delete data in a table using Geodatabase connection in the writer but it shows this error message while insert : An error occurred while attempting to store a row into the table 'FCL_EQUIP'. The error number from ArcObjects is: '-2146232832'. The error message from ArcObjects is: {ArcGIS-error creating a new feature !(BaseUserSession::Application not initialized.)} and this while delete : Error while deleting feature in the table/feature class 'FCL_EQUIP. The error number from ArcObjects is: '-2147217402'. The error message from ArcObjects is: {}All edits made during the edit session were savedA fatal error has occurred. Check the logfile above for details
Hello everyone!I am beginning this conversation with two goals in mind. First, I would like to share and discuss my new transformer OpenAIGeographicCreator, and second, we at Safe would like to see how a post of the new type, “Conversation” performs in the community. The idea is to have a way to expand conversations beyond simple “question-answer” style and have meaningful discussions among multiple participants about problems, solutions, functionality and everything FME related. Here, we could run our ideas by the whole FME community, get advice or inspiration and share our successes and even failures - together, we may be able to help.So, the story of this transformer began with @bruceharold’s idea here: I quickly made a working prototype and realized that OpenAI can really create geometries in the form of GeoJSON from a free-form text description of a location. For example, we can ask the API to give us a center point and a bounding box of Vancouver or a much smaller town in Finlan
Hello FME community, I have an issue I'm working on and can't seem to figure out the solution. I have two Excel tables. One with different kinds of certifications and the score each is given.Certification Score Certification_A 1 Certification_B 5 Certification_C 7 The second one contains Applicants with fields defining the various certifications and links to said certification. One applicant can have multiple certifications. We need to determine for each applicant which is the highest scoring certification.Applicant_ID Certification_A Cerification_B Certification_C 1 URL to file 2 URL to file 3 URL to file URL to file In the second table I want to add the scores and then determine the highest score for each row (this i can do in a new field with the max(Value1, Value2 etc) function) and write out the applicant_id, the highest scoring certification name, it's URL and the score.Can anyone give me some pointers how i can solve this case?T
I have a process that uses a change detector transformer to compare address data from one database and update the data in a second database based on differences in the dataset. It works great normally but the other night it updated, but I had an extra 85000 records that ended up being duplicates of existing records. Both these databases are SQL server ESRI Geodatabases and are using the same SQL server instance. What I think happened is that the database instance was failed over while the FME process was in the middle of running, which disconnected the session temporarily and when reconnected started reading records again which looks like it started reading the records from the start but still included the records that were already read in addition. Is there something I can do or set when a database is failed over in the middle of running a process to prevent this issue?
I have an Excel 365 .xlsx spreadsheet that I am trying to read into a FME 2021 workspace. When I try to read it, it gives me an error message: |ERROR |Excel Reader: Could not open file '...\input.xlsx', file is too large. Try switching to 64-bit FME, or exporting the Excel file to CSV. If the file is exported to CSV, formulas and formatting will be lost...T I cannot change the spreadsheet to a .xls, it has to remain a .xlsx. Any ideas on how to solve this? The spreadsheet I need to read is 22mb with approximately 93,000 records.
I have a collection of as built drawings stored as PDF’s and wanted to automate the creation of image files being used as thumbnails in a web application. I was wondering if anyone has done this before. I am currently using the Workbench 2018 PDF reader and attempting to rasterize using either ImageRasterizer or MapnikRasterizer.
I hope this post makes sense. I used a list an attribute splitter -> list exploder -> attribute creator to assign a value based on conditional criteria. I now need to filter the data using the following logic: Take the minimum “_element_index” WHERE “Review Status” (newly created attribute) has a value, else use the MIN(element_index).There would be a Group By: “Project Number”Any help would be greatly appreciated
Is there anyway to read in attachments while using the FeatureReader transformer. I know there is an option with the ArcGIS Online Reader but I don't know my Where Clause until after certain point in my workflow. Feature Reader was working perfect until I realized I couldn't read in attachments. Any help would be great!
Hi, My workspace has an AGOL reader (reads attachments too). Features are compared to existing SDE records and new features are then processed into the SDE (photos go to our DMS). Unfortunately, all AGOL records and attachments have to be read before comparison - even with our fast internet, it still takes 5 seconds per feature (6 photo attachments). Our test dataset has 1500 records (9k photos) and the production dataset has 100k records.My idea was to read the AGOL dataset WITHOUT attachments and then use an AGOL FeatureReader to just read the new features WITH attachments, but... FeatureReader is (or at least was) unable to work with attachments.The rest of the workspace is fairly involved, so I don't believe this is a case for a WS Runner. Ideas will be much appreciated.Cheers,Mark
I wanted to run a single sql query but with multiple variable value depending on my user input (to a parameter).For Example :When I type in VEGETABLE in my user parameter I want to run “SELECT * FROM <vegetable_name>”, where I have a bunch of different values for my <vegetable_name> variable, additionally I want to join all the data procured from running the query for all vegetable_names.
I use the “Esri ArcGIS Layer” reader to read an .lpkx file that contains 2 different feature layers, with different geometry (lines and points) but the reader fails to read both layers. It reads only one of the layers. Anybody with the same issue?FME Desktop ESRI Edition 2022.2.2.0ArcGIS Pro 3.2.0 64bitThanks!