Using readers and writers to extract and load data.
Recently active
Hi All,Is there any way to read multiple GDBs saved on the company Sharepoint? Does the Sharepoint need to be publicly accessible? I get an error when try to use the URL link and load the GDB, Also I would like to know a workaround to read individual GDBs, Any Ideas? The GDBs are saved in individual folders so need to iterate thought these, example of the folder structure below: Example of the individual content folder below:
Hello FME Community,I'm currently working on a project that involves a large number of subdomains and domains, and I have my data available in table format. I'm looking for guidance on how to organize this data into a geodatabase (GDB) using FME, while adhering to domain conventions.Specifically, I would like to know:How can I create subdomains within a GDB using FME? What steps are involved in defining domains for attributes within the GDB? Are there any best practices or recommended workflows for organizing subdomains and domains efficiently?Any insights, tips, or examples would be greatly appreciated. Thank you in advance for your help!Best regards,Vishnu N V
I’m looking for a way to move points which are spaced at “x” distance from one another to a nearby road (line) shapefile. I want to maintain the same “x” spacing along the road once the points are moved to the line.
Hello everyone,I'm facing a challenge in processing data in Excel and I'm seeking assistance. I need a method to search in one Excel table for entries that contain values from another Excel table and then create a new table with the found entries.Specifically, I want to search an Excel table (Table A; 8 collumns) for certain keywords. These keywords are located in a separate Excel table (Table B; 1collumn). When any of the keywords are found in Table A, I'd like to create a new table with these entries.I would greatly appreciate any advice, tips, or examples that could help me solve this issue.Thank you very much in advance for your help!
Hello,I need some help.I am a major student and I am in my final paper for my diploma. I Have to make a 3D map of a town using Citygml.I have used Arcgis to create the shape file and pgadmin to create a data base.But when I try to connect my database to Citygml It doesn’t work.When I open the command line to insert the parameters it says that there is a problem.I have installed postgresql and Java in my computer.i don’t know if someone can help me but you are my last hope haha(Not an native English speaker so if something is not explained good please be understanding)
I am reading data from a PostGIS table and writing to an ArcGIS eSDE, but I’m not able to create tables in the eSDE from FME, I can only write to tables created by ArcGIS Pro in the eSDE, is this normal? I'm getting an ArcObjects error ‘-2147220655’, DBMS table not found.
Hi FME users, The main purpose of my recent FME workflow is to GET the files from the folder from the FME server using HTTPCaller. Although the process displayed green which means the process is running correctly, the inspector showed the HTTP status code 200, which means the results are rendered in the response body (Figure 1. ) but not created successfully in the local drive. Figure 2 is the basic setup in HTTPCaller. Figure 1. FME Inspector. Figure 2. HTTP Set-up Then, I tried another URL copied from FME API using POST, /fmerest/v3/resources/connections/Data/download/Logo/CPB_Logo.jpg, then the FME gave me the HTTP error code 403 FME Server is version 2023.2.1FME workbench is version 2021.2.3 Do you think it is because of the Version or some other issues? Thanks,Du
Hi, I'm reading around 5 million rows from the 252 Excel files. I need to view the rows to delete many columns and edit values, but indexing the results is taking a long timeHow can I improve this? Thank´s
I have an AttributeManager in a custom transformer (may be part of the problem but thought I would start simple with the AttributeManager) that has the following data (correct) on the input but the name of the attribute (not the attribute values) is assigned in the output.Input Attribute “Public_Water_System_ID” with correct values and output with wrong values:Settings in the AttributeManager is as follows:For data type I’ve tried buffer (default), varchar(20), and char(20). None of the other types seemed to make sense since the values are string.Perhaps a related problem is that this attribute (“Public_Water_System_ID”) is passed as a parameter into this custom transformer and is seems like there might be an issue with the transfer. However, that being said, the correct values are appearing at the input port of the AttributeManager which is downstream from the custom transformer input.
Wich versions FME desktop are compatible with pluggin Smallworld 4/5?
Hello, i’m triying to insert / delete data in a table using Geodatabase connection in the writer but it shows this error message while insert : An error occurred while attempting to store a row into the table 'FCL_EQUIP'. The error number from ArcObjects is: '-2146232832'. The error message from ArcObjects is: {ArcGIS-error creating a new feature !(BaseUserSession::Application not initialized.)} and this while delete : Error while deleting feature in the table/feature class 'FCL_EQUIP. The error number from ArcObjects is: '-2147217402'. The error message from ArcObjects is: {}All edits made during the edit session were savedA fatal error has occurred. Check the logfile above for details
Hello everyone!I am beginning this conversation with two goals in mind. First, I would like to share and discuss my new transformer OpenAIGeographicCreator, and second, we at Safe would like to see how a post of the new type, “Conversation” performs in the community. The idea is to have a way to expand conversations beyond simple “question-answer” style and have meaningful discussions among multiple participants about problems, solutions, functionality and everything FME related. Here, we could run our ideas by the whole FME community, get advice or inspiration and share our successes and even failures - together, we may be able to help.So, the story of this transformer began with @bruceharold’s idea here: I quickly made a working prototype and realized that OpenAI can really create geometries in the form of GeoJSON from a free-form text description of a location. For example, we can ask the API to give us a center point and a bounding box of Vancouver or a much smaller town in Finlan
Hello FME community, I have an issue I'm working on and can't seem to figure out the solution. I have two Excel tables. One with different kinds of certifications and the score each is given.Certification Score Certification_A 1 Certification_B 5 Certification_C 7 The second one contains Applicants with fields defining the various certifications and links to said certification. One applicant can have multiple certifications. We need to determine for each applicant which is the highest scoring certification.Applicant_ID Certification_A Cerification_B Certification_C 1 URL to file 2 URL to file 3 URL to file URL to file In the second table I want to add the scores and then determine the highest score for each row (this i can do in a new field with the max(Value1, Value2 etc) function) and write out the applicant_id, the highest scoring certification name, it's URL and the score.Can anyone give me some pointers how i can solve this case?T
I have a process that uses a change detector transformer to compare address data from one database and update the data in a second database based on differences in the dataset. It works great normally but the other night it updated, but I had an extra 85000 records that ended up being duplicates of existing records. Both these databases are SQL server ESRI Geodatabases and are using the same SQL server instance. What I think happened is that the database instance was failed over while the FME process was in the middle of running, which disconnected the session temporarily and when reconnected started reading records again which looks like it started reading the records from the start but still included the records that were already read in addition. Is there something I can do or set when a database is failed over in the middle of running a process to prevent this issue?
I have an Excel 365 .xlsx spreadsheet that I am trying to read into a FME 2021 workspace. When I try to read it, it gives me an error message: |ERROR |Excel Reader: Could not open file '...\input.xlsx', file is too large. Try switching to 64-bit FME, or exporting the Excel file to CSV. If the file is exported to CSV, formulas and formatting will be lost...T I cannot change the spreadsheet to a .xls, it has to remain a .xlsx. Any ideas on how to solve this? The spreadsheet I need to read is 22mb with approximately 93,000 records.
I have a collection of as built drawings stored as PDF’s and wanted to automate the creation of image files being used as thumbnails in a web application. I was wondering if anyone has done this before. I am currently using the Workbench 2018 PDF reader and attempting to rasterize using either ImageRasterizer or MapnikRasterizer.
I hope this post makes sense. I used a list an attribute splitter -> list exploder -> attribute creator to assign a value based on conditional criteria. I now need to filter the data using the following logic: Take the minimum “_element_index” WHERE “Review Status” (newly created attribute) has a value, else use the MIN(element_index).There would be a Group By: “Project Number”Any help would be greatly appreciated
Is there anyway to read in attachments while using the FeatureReader transformer. I know there is an option with the ArcGIS Online Reader but I don't know my Where Clause until after certain point in my workflow. Feature Reader was working perfect until I realized I couldn't read in attachments. Any help would be great!
Hi, My workspace has an AGOL reader (reads attachments too). Features are compared to existing SDE records and new features are then processed into the SDE (photos go to our DMS). Unfortunately, all AGOL records and attachments have to be read before comparison - even with our fast internet, it still takes 5 seconds per feature (6 photo attachments). Our test dataset has 1500 records (9k photos) and the production dataset has 100k records.My idea was to read the AGOL dataset WITHOUT attachments and then use an AGOL FeatureReader to just read the new features WITH attachments, but... FeatureReader is (or at least was) unable to work with attachments.The rest of the workspace is fairly involved, so I don't believe this is a case for a WS Runner. Ideas will be much appreciated.Cheers,Mark
I wanted to run a single sql query but with multiple variable value depending on my user input (to a parameter).For Example :When I type in VEGETABLE in my user parameter I want to run “SELECT * FROM <vegetable_name>”, where I have a bunch of different values for my <vegetable_name> variable, additionally I want to join all the data procured from running the query for all vegetable_names.
I use the “Esri ArcGIS Layer” reader to read an .lpkx file that contains 2 different feature layers, with different geometry (lines and points) but the reader fails to read both layers. It reads only one of the layers. Anybody with the same issue?FME Desktop ESRI Edition 2022.2.2.0ArcGIS Pro 3.2.0 64bitThanks!
I am reading two AutoCAD files and sending them through a ChangeDetector to identify the differences between files. For my updated features, I am trying to write out the attributes to my blocks to displayy the following attributes as extended entity data:Id, Update_1,Update_2, Update_3 (all the way through Update_10)Writer Feature Type Showing all the attributes.However, when I open the drawing, the Extended Entity Data is being written as such:Block Extended Entity Data is repeated, missed, and “garbled”.Can someone give me some advice as to why this may be happening?
Is it possible to clip a Civil 3D surface using FME and then export it as a Civil 3D surface DWG file?
When I write to AGOL I get the following error message:|ERROR |Attribute(64 bit real) : `Company_Material_Unknown' has value `1312'I’ve tried various data type for both the writer and the attribute manager before the writer. Nothing works. I have another AGOL writer in another place in the FMW (different data stream) and it works fine.
I am calculating measure values on a polyline from mile post signs, but we’ve found a problem with the input data. There are a number of streets that are circles. The street name is the same all the way around this loop, and the mileage increases clockwise around the loop, but when it gets back to the intersection, there are a few incorrectly placed mileposts. How would I go about throwing out mileposts that change direction, such as going from increasing to decreasing, while on the same street?