Using readers and writers to extract and load data.
Recently active
I am currently attempting to use the las file reader in FME 2019 on multiple files. Unfortunately, the files are not all the same schema. So, I was wondering if it was possible to read these into a dynamic schema? I have attempted to create a dynamic workspace with the reader and when attempting to choose the feature types to read the following error is received: "SOURCE_READER statement must be of the form 'SOURCE_READER <reader type> [<parm> <value>]*' -- `SOURCE_READER WLAS SCHEMA_MODE FEATURE_SCAN -_ENCODING' is invalid : Row came from between lines 1 and 7 of file C:\\Program Files\\FME\\metafile\\WLAS.fmf Failed to read schema features from dataset <path> using the 'wlas' reader"
I have a distributed MS Access app with linked tables that has grown to big and has too many users. We need to re-write into a web app. There are many tables, queries, forms, reports etc. so I expect this will not be a quick process. I'm interested in any advice offered on this undertaking. As a first step, we are moving the DB to SQL Server. The reports will be converted to a standard reporting technology like Business Objects or Tableau using the SQL Server. We'll use Python or Java for backend DB connectivity. I'm hoping there is an easy way to convert the UI into HTML pages. Several pages in the Access app consist of forms with drop down list boxes, radio buttons, check boxes, etc. Any advice?
Could I ask ,How could I look up in field names in Attribute A in oracle no spatial and extract the row of these field names that what am i looking for.I would like to compare between Excel file as reader and oracle non spatial reader and if some field names in Attributes A is missing in excel file so I would like to extract the missing from oracle non spatial And another case ,compare between excel file and oracle no spatial If It finds one field name in excel file is extra sure so I want to look also for this field Name in oracle and extract the row that include this field But I want to say ,excel file and oracle non spatial have one common attribute and the rest of attributes are totally different but I would like to search for this field name and extract the row that relates to this field and put new data in another sheet has the same attributes as oracle..FME version 2018
When trying to Batch Deploy my simple Geopackage files to AGOL the 'Next' button never gets possible. It wants a path to the files to be written. Is it not possible to use Batch Deploy to upload to AGOL or what am I missing?
When I try to write an ECW file of around 1 GB, I get the following error from the ECW writer:ECW writer: The ECWJP2 SDK only has 200.0 MB of memory allocated to it and this is not enough to compress this dataset. Please set the SDK's memory limit above 203.9 MBThat sounds fair enough. Does anyone know how to allocate more memory?Using FME Desktop 2019.2.
Hi FME'ers,I am having trouble authenticating any OAuth 2.0 web connections with FME Desktop 2018.1 (Build 18528). I am trying to access ArcGIS Online but this problem occurs with any OAuth 2 service. I understand that the issue is with my organisations proxy/firewall but I am trying to diagnose precisely where the failure is occurring. FYI, We use a pac file proxy.In Options > Network Proxy, I have 'Use system proxy settings' checked. I know I can get access to the internet with this setting because I have access to FME Hub and can use HTTPCaller. In Web Connection > Manage Services, I select the new connection I created for AGOL and click Test. The credentials screen appears so I enter my credentials and click Sign In. I then get a Network Error dialog box saying "Failed to obtain refresh token: Error retrieving access token. Check Log Window for more details." In the log file I get the message: "407 Proxy Authentication Required" followed my a w
I have a folder with 92 LAS files, see screenshot with example of one LAS file: .Which transformers and non-default settings are required to make these files into one or more FBX files? A direct reader/writer translation results in an empty FBX file.Any help/suggestions/examples is much appreciated!
I have a webpage that has links at the top of the page. Clicking the link brings you down the page to the relevant info (Name Name). I have extracted and parsed a list from the links, and I am now trying to get the data from each link. any ideas? The Href are the links and the h2 id are where the links bring you to I want all the data until the next h2 id. I keep getting the same data if any... <li><a href="http://www.link.com<a></li><li><a href=" http://www.link2.com </a></li></ul><br/><hr/><h2 id="1">Name Name</h2><p><strong>This is the beginning</strong><br/>DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA </p><p><strong>Description</strong><br/> DATA DATA DATA DATA
How to compare a series of tables across two databases? We use a setup that reads a .csv file that has two columns:- Column 1 is a query in database 1, and- Column 2 is a query in database 2Both queries should return the same and ordered list of values (basically, a list of identifiers) and are fed into an SQLExecutor. Both resulting streams are compared using a FeatureMerger, and the UnmergedRequestor and UnUsedSupplier ports report the features that are not present in both databases. This works nice for relatively small tables. If a table is queried that has more than a million records, performance drops. I solved this performance issue by using database readers. I specified the Number of Records To Fetch At A Time (ORACLE) and the Bulk Read Size (MSSQL) and set them so that 100.000 records are fetched each time. I could work this out using a WorkspaceRunner, however my question is: Where are these parameters on the SQLCreator/SQLExecutor transformers?Parameters available on the SQLE
There is no PointCloud element in the Python API and I can't find any function or factory to do it. Has anyone found a way (apart from parsing the log)?
Will there be an update for FME 2019 to make it compatible with ArcGIS 10.8, or do I need to wait until the release of 2020?
Hi FME Fans,Is there a way to run a .dll file from within FME and also pass data to it?Cheers
I have around 100 cells that located in third attribute (machine ) and I want to change the back ground for cells that has specific name old to blue color,i converted the excel file to csv then write again to excel file in my workspace so If i want to look for names in csv ,so my question does excelstyler has another methid not as excel to look for names in csv file.I tried a lot by excel styler but it does not give me result .and also I want to select input for excel styler as row bcs I found it has only option for attributes ,for column but I want to work on rows to alignment line for each specific row ,FME version 2018.Thanks
I have a DXF file containing many feature types, including points, polylines, polygons, text etc. I want to extract the polylines into a shapefile of polyline geometry, and the points into a points shapefile. I am having a hard time finding the transformer(s) needed to carry out this simple task. Can someone please point me in the right direction? Regards, Ben
Hi all, I found this wonderful piece of informatjon in the description of ArcSDE reader (http://docs.safe.com/fme/html/FME_ReadersWriters/Default.htm#sde30/sde30.htm%3FTocPath%3DFME%20Readers%20and%20Writers%20(formats%20supported%20by%20FME%202014)%7CEsri%20ArcSDE%20Reader%2FWriter%7C_____0): The SDE reader can also perform multi-table join queries, thereby exploiting the full power of the underlying RDBMS. Cool... I wanna do that, and most likely either the ArcSDEQuerier or ArcSDE reader, whichever is most convenient. But I can't seem to wrap my head around the syntax. Composing a valid JOIN statement in SQL should be fairly straightforward, but that doesn't really seem to fit into the concept of WHERE Clause. Or I cant figure it out... Problem description: I have a huge ArcSDE database. I and I want to extract all data from table A, and a subset of information from table B, only extracting those whose ROUTE_ID values match ROUTE_ID in table A. In my head, this should
Hey FMErs! Wondering if anyone here has worked with an Internet Query (.IQY) file downloaded from a sharepoint site before! When I open the link in a web broswer (IE11 in this case) it'll prompt a download for this IQY and it'll resolve into a excel spreadsheet! I want to run a automated process on this file from FME but when I use use a XLS reader or HTTPCaller transformer all I've been getting are error messages or the 'GET' response:(left out some details as its internal)WEB1https://xxxxxSelection={7EB5B6E8-8458-4F92-925E-A3EB593229E7}-{9814593B-164C-4604-A5DD-4CAF07C9FDF7}EditWebPage=Formatting=NonePreFormattedTextToColumns=TrueConsecutiveDelimitersAsOne=TrueSingleBlockTextImport=FalseDisableDateRecognition=FalseDisableRedirections=FalseSharePointApplication=https://xxxxx/_vti_binSharePointListView={9814593B-164C-4604-A5DD-4CAF07C9FDF7}SharePointListName={7EB5B6E8-8458-4F92-925E-A3EB593229E7}RootFolder=Thanks in advanced, Patrick
Hi FME and ESRI users, In an SDE feature class archiving is turned on.When writing a record in update mode, an attribute is blanked out, all other attributes get values.But redirecting to the Data Inspector shows a value for the attribute. We checked the data type in SDE and FME and they match. Any idea what could be causing this issue? Your suggestions are highly appreciated.
could i ask how to get the list of attributes from oracle non spatial.iam a little bit confused from oracle files .i added a reader for oracle non spatial but i could not check the oracle on inspector when i conenct with inspector i see nothing,is there a way to inspect it while iam working on workbench . and when if i want to extract only the attributes ,how could i do that i want to extract the attributes in table Thanks in advance
I am using SQL executor to perform insert command to insert table data into Oracle. I have a column with geometry and data type as SDO_Geometry in already existing oracle table. The current geometry I want to insert into oracle is in UTM format. I have converted it using geometry replacer and reprojector in my workspace.SQL Executor is throwing an error with too long string literals and can not be inserted.What is the way that I can insert geometry column with UTM coordinates into Oracle SDO_Geometry column?
Here I am trying to get the sequence before writing data into oracle. All I need to do is to start this sequence with the value of 5000000000.As we can use this in insert function - "insert into nb (XFM_ID) values(XFM_ID_SEQ.NEXTVAL + 5000000000)"But this is not working in FME. I tried all possible ways to insert sequence starting from 5000000000 like using sql creator,executor etc. Sequenced Table columns does not accept " XFM_ID:XFM_ID_SEQ.NEXTVAL+5000000000"
I am looking to insert a new feature into the output geodatabase here. The translations uses a feature reader to read a source geodatabase based on a user defined parameter which defines which feature classes the user wants to bring over. However I also need to add second feature class but instead of reading from a source I need to add a new record which i intialize from the creator. In this case though because the output writer uses a dynamic schema, I don't know how to insert this new feature or to indicate which feature class it should be written to. Any ideas?
I am trying to write data from GDB file into oracle database using SDE writer. Its giving below error Could not unregister GlobalID column 'GLOBALID' in table TABLE_NAME. The error number from ArcObjects is: '-2147215875'. The error message from ArcObjects is: {Table is already locked [TABLE_NAME]}
Hello,I need to create and implement control rules which can show that my object (in GML) has dupplicate vertices.I have reader "GML file" with the element which geometry is:<bdz:geometria> <gml:Polygon gml:id="geom.9acd0ccc-6a2a-4dfa-8e70-487b08d83e7b" srsName="urn:ogc:def:crs:EPSG::2176"> <gml:exterior> <gml:LinearRing> <gml:posList>5947602.08 5474440.64 5947598.85 5474445.14 5947598.85 5474445.14 5947602.08 5474440.64 5947603.36 5474448.24 5947606.44 5474443.96 5947602.08 5474440.64</gml:posList> </gml:LinearRing> </gml:exterior> </gml:Polygon> </bdz:geometria> It contains 7 vertices (1 dupplicate vertex), but when I add inspector, FME show me that there is 6 vertices: Neither the geometry validator nor the coordinat
Hi, the result of my workflow is a raster and I would like to publish it on ArcGIS online automatically with FME. Is it possible? Thanks
HelloI am attempting to make non spatial Oracle table data spatial, I have created the FME workbench no problem but when it comes to writing the results to an Oracle table using Oracle Spatial table no points are displayed just the data.Basically I am missing the accompanying spatial data to the points. I am sorry if my post makes no sense and please ask any further questions. Many thanksSy