Using readers and writers to extract and load data.
Recently active
Hello!I'm trying to parse JSON data returned from the API for Oracle Service Cloud. I've figured out the HTTPcaller piece and the data is returned like this:{ "count" : 10000, "name" : "OpenData REST export", "columnNames" : [ "Address", "Channel", "Date Closed", "Date Created", "Date Last Updated", "Disposition ID", "Latitude", "Longitude", "Product Hierarchy", "Product ID", "Service Request ID", "Status Type" ], "rows" : [ [ null, "Email", "'2018-06-20 12:46:36'", "'2018-06-19 17:36:19'", "'2019-08-20 18:22:39'", null, null, null, "Parking", "Valid monthly permit", "2296", "Solved" ], [ null, "Email", "'2018-09-06 10:13:19'", "'2018-06-19 18:28:00'", "'2019-08-20 18:22:38'", null, null, null, "Parking", "Disputing information on offence", "2299", "Solved" ], [ null, "Email", "'2018-06-28 14:45:50'", "'2018-06-19 19:07:40'", "'2019-08-20 18:22:38'", null, null, null, "Parks", "Residential new tree request / replacement tree", "2303", "Solved" ]...etc} I need to
i have some sample DTED (*.dt0 and *.dt1) files that contains grids of elevation data. I like to know if its is possible to convert this data in to 3D tiles and display them in a CesiumJS map? i tried some ways as seen in a post "How to Bring 2D Data into CesiumJS"from @dmitribagh but my inputs are different from that. so i appreciate if anyone can share any ideas. Thanks
I have a workbench that is reading from an already populated FGDB with 140 Feature Classes. I am trying to add an extra column to the majority of those feature classes and then populate the column for each row with a URL and ID to match the row. I am finding that it is taking 6 minutes to write back 60,000 rows and considering there are over 10 million to update that is an unacceptable timescale.I am creating the new attribute and a non spatial index with a python caller. Feature Reader to get the ID of each row. AttributeCreator and Manager to create the URL and merge it with the ID. Finally an AttributeFilter to the FeatureWriter. In the FeatureWriter I am doing an Update and using PrimaryKey columns for the row selection. I would appreciate any thoughts on how I might quicken the process.
Hi, sorry im struggleing to convert KML to shp, i can get the shp files converted but i cant seem to transfer any names of the files
I have tried to meka a flat file out of an xml file but I can't get the parent data onto every row of the child data. How can it be done? here is snippet of the xml file: <?xml version="1.0" encoding="UTF-8"?> <event Type="Relay"> <eventname>Lappee-Jukola 2016, Jukolan Viesti</eventname> <class> <classname>JU</classname> <team> <teamid>9</teamid> <teamname>Koovee</teamname> <teamnro>1</teamnro> <result>8:03:46</result> <tsecs>29026</tsecs> <placement>1</placement> <leg> <legnro>1</legnro> <nm>Topi Anjala</nm> ,....so I'd need to get all this data on the same row for each result:eventname, teamid, teamname, teamnro, result, tsecs, placement, legnro, nmJukola,9,Koovee,1,8:03:46,29026,1,1,Topi Anjala
Hi,is there any sources to use the git in FME unlike Eclipse, pycharm….
HiI have a csv file with the name of an electricity pole and the oblique images where the pole is visible on.Now I want to pull these images from a folder with a large collection of images containing the images I want and copy them to the folder with the csv. I dont know how to import a folder or a path. I have seen them but cant seem to find in the readers... I don't know how to copy. Please be elaborate with the explanation, because that's something I never have done with FME.
FME 2020 supports the Google Vision API with the transformer GoogleVisionConnector. The user just have to enter their Gmail address in the transformer (and then approve the connection with FME) to make use of the functionality. The documentation of the transformer informs that The GoogleVisionConnector uses your Google Cloud account credentials to access the Google Vision client services.With this forum question I just want to clarify the pricing of using the Google Vision API with the GoogleVisionConnector transformer. Is it correct that the transformer uses the API so that this pricing table applies? https://cloud.google.com/vision/pricingWhat happens when the amount of API calls exceeds 1000 units/month? I can assume that Google will send an email to the connect Gmail account but what happens in the GoogleVisionConnector transformer? What is the reply from the API and how is it interpreted in FME? Will it come out of the Rejected port?
H? all,I am trying to write my data over gdb and sde by processing. Some columns containing integers write null.fme is working fine. I'm not getting an error. but when I look at the database it looks null. How can I solve this problem. Thank You.
Hi, we would like create some terrain models for cesium - is it possible to create TIN quantised meshes that are directly compatible with CesiumJS?Thank you
I am currently updating a number of documents and models on a CDE (currently trying to pull the API information) that require manually logging into the system as an administrator, deleting the files in question and then uploading the updated file.I wanted to see if there was a way to automate this procedure through an FME workbench?
Hi All, I am really excited to learn new tool and work with new tool, new project new task really challenging !AS, I said, I am new to FME data integration Platform, I am really struggling where can I start. AS an Automation tester came from python background, I need to automated the TOID lines, sites..., My project include with Technologies ArcGIS and FME. Could you please suggest me any tutorial or any use case related to Geo spatial Maps.(I have excel, .fme, .gpkg files). Apologies for lengthy question, I really nee to run the test and develop more based on them ThanksRegards
Hello. I have a txt file which contains "blocks" of data, separated by line containing #####. I need to extract information from each "block", and each time the #### appears that means the new epoch starts. For each block I check if it contains eg. "Station point:", "PPM", "MWF". Each Feature is then written in DB. Not all blocks give results for each Tester.Here is an example of such file:2020-03-23 08:01:13.8810 Info ############################################################################################################################################### 2020-03-23 08:01:13.8810 Info Processing pointgroup 'MWS200_Fix' (Type:'Freie Stationierung') measured by 'MWS200'. [GON/M] 2020-03-23 08:01:13.8810 Info Station point: 'MWS200' 2020-03-23 08:01:13.9122 Info Station coords: 2660392.8147,1251984.6680,416.3654 2020-03-23 08:01:13.9435 Info Reference coordinates of 'MWF204': E=2660397.8542,N=12
I get the following error message when reading esri gdb in zip folder. Reader not functioning as expected in both Desktop and Server when pointed to zip file. When extracted and reader pointed to gdb, it works. Error -2147024893 The ArcObjects license 'Standard' is being selected from the Windows registryFME has checked out an Esri license. The product checked out is 'Standard'Installed ArcGIS version is '10.8'Unable to connect to the File Geodatabase at 'D:\\xxx\\xxx\\Compressed\\FileGeoDB.gdb.zip'. Make sure the correct filename was specified, and that the geodatabase wasn't saved with a newer version of ArcGIS than the one installed locally. The error number from ArcObjects is: '-2147024893'. The error message from ArcObjects is: {} Is it mandatory to extract the files manually before executing the workbench. Or do we have any work around. ThanksSiva Bulusu
I hope the title is already quite self explanatory.As an example, consider the following JSON document;{ "boolean_1": true, "boolean_2": false}When this is being read with a JSON reader, it returns the following output;I would prefer the data to be non altered, so that comparisons can be made later on.See also the following attached sourceFile and workspace; To me it reminds me of the following item I addressed earlier on;https://knowledge.safe.com/questions/90726/extracting-nested-object-with-jsonextractor-issue.htmlin which a JSON Extractor used to convert JSON boolean values (i.e. true/false) to 1/0 boolean values, where I'm glad to see that that got fixed.To me it only raises some concerns that the handling of these values doesn't seem to occur in a very consistent manner; whereas a JSON fragmenter does seem to keep JSON boolean values intact, initially a JSON Extractor converted these values to 1/0, and now I find that a JSON reader converts these values to Yes/No. :(
i have reader oracle spatial and i would like to export only specific area and the intersected of this area only .i do not want to export all areas from oracle reader because it spends too much time so i would like to export the interested areas only from oracle . i did already spatial filter after that and it works great but the problem it takes too much time to export all areas then execute spatial filter so is it possible to write code inside where clause and as a result as give me rrequired areas without upload all areas .Thanks alot
I have a Excel-file with the following content: group1group2group3nameinfoGeneralNation Philinfo1GeneralNation Kareninfo2GeneralMunicipality Billinfo3GeneralMunicipality Paulinfo4SpecificProvince Patrickinfo5SpecificProvince Maikelinfo6SpecificProvinceGovernanceMikeinfo7SpecificProvinceGovernanceLukeinfo8SpecificDistrict Mariainfo9SpecificDistrict Davidinfo10 The attributes can be adjusted it is a Excel-file; I create the file myself.I would like to automatically create a nested JSON file. This should look like this: "name": "Overview", "children": [{ "name": "General", "children": [ { "name": "Nation", "children": [ {"name": "Phil", "info": "info1"}, {"name": "Karen", "info": "info2"} ] }, { "name": "Municipality", "children": [ {"name": "Bill", "info": "info3"}, {"name"
I tried to fuse the shapefile information with the point cloud. When I clipped the point cloud based on the shapefile polygon boundary, the information of the count number of each polygon is supposed to be attached to the point cloud attribute. I saved this information in the userdata attribute but it is Uint8 data type, my count number should use int16 to cover the range. Is there any solution that can set the userdata data type as int16 without converting by the application automatically ?
When you view an fgdb mosaic dataset in ArcMap, the footprint and boundary are features that are shown and editable. I can read the fgdb raster dataset in FME but I can't figure out how to access the footprint and boundary datasets. Is this data accessible?
Hello, I'm still a relative newbie to FME, so bear with me. I'm trying to update our topographic CAD dwgs with our updated LiDAR derived contours. I only want to replace the existing contour layer and maintain all other layers in the existing CAD dwgs. I'm just not sure how to proceed. The contours are already clipped to the same index grid as the dwgs. Any guidance to the correct path of transformers would be most appreciated. Thanks everyone, be safe out there and wash those hands!
HI, I looked at this great article: https://knowledge.safe.com/articles/38908/autocad-workflows-reading-and-writing-text-mtext-f.html And tried applying it for my project. By creating label of my feature id then using DWG styler:label = @Value(ID)gThe problem I have is that these do not text as the example article but creates a block with text tags. If I manually add text in autocad I get this: RIght TextBut instead I get this: Block ReferenceI wrote the text in a separate layer called LayerLabels, I even added a AttributeManager adding a new attribute autocad_entity = autocad_text and activated format attributes "autocad_entity" in the writer to maybe force it to read as text but its still created as a block.My writer:IN bentley it says its an FME block, but I never set any blocks and my only reader is a shp readerThis below is also supposed to say text with a T sign next to the Acad and supposed to show the text Any ideas?
Is it possible in FME to create empty Esri file geodatabases without any feature classes inside? Like how you would manually create them in ArcCatalog.
Is there a way to determine if a DWG Layer has been frozen in a viewport?We are reading in a DWG and want to output that to a TIFF Image but AutoCAD has a function that allows layers to be frozen in a particular viewport but I can find an attribute that indicates that for an individual feature.If I read model space through the viewport the layers frozen for that viewport are still be display and then output to the TIFF.Snapshot of DWG Viewport Snapshot of TIFF
I've just recently gotten started with FME, and have been converting point cloud xyz files to Mojang Minecraft format. My converter works for a couple files, but yields a cryptic error message for most of the files I've tried: MINECRAFT writer: Internal Error: Failed to create a valid block index in regionX: '-1', regionZ: '-1', chunkX: '30', chunkZ: '30'Since I've already scaled and shifted heights (z-coordinates in the point cloud, y-coordinates in Minecraft) well within the limits of Minecraft, and this is a chunk error, I feel I can safely assume this has nothing to do with height. I wasn't able to find any documentation of width and depth limits to the Minecraft writer, and the point cloud is scaled to a 64x64 area, so I'm not sure what's going on here.Any help is greatly appreciated! I can't find much information on the Minecraft writer.
Hi, I have a shapefile 1 in which I can move common points between features with topological edition active in Qgis, without problem.After I read the file in FME and write it to another shapefile 2, this last one cannot be edited the same way (common points are moved separately even with topological ediiton active in Qgis).I tried to reduce the workspace to the minimum, means no transformer at all, only shapefile reader and shapefile writer ! Same behavior. Did you already have this behavior ? I don't know what I do wrong... I can send the shapefile if needed.