Using readers and writers to extract and load data.
Recently active
I ahve two formates of data text(.txt) and (Excel(.xlsx) The data is in bellow form.I want to insert this data into smallworld by using FME. The data Formate as bellow in .Txt and Excels.
Does anyone know if it possible to get fme to write out tab files as .TAB rather than .tab
When filtering CityGML dataset (with AttributeFilter) the Inspector shows different results than Writer outputs. Why?I have cityGML with a lot of buildings, but based on their id I need to filter few of them out. I use AttributeFilter and when I check result in Inspector everything looks like I want it to look, but when I write the output it has lost all geometry and is completely different.
Dear community,I have a hypothesis which states that using the csv module and Python 2.7 to perform a simple processing task using the data stored into a big *.csv is going to have a significant positive impact in the time needed to perform the task in contrast to using the FME tools to perform the same task. I have assigned both software the following simple task into a "startup python script" in an empty workspace with one published parameter ('OSG_SDTF') which is used to acquire the path of the *.csv to be used in the task.(A) Read a big *.csv file (i.e. 17,977,400 records with the values found in 19 columns which are stored within a single 2 GB comma-delimited *.csv file).(B) Return a set (i.e. not duplicates are allowed) of the values found within one column of the big *.csv ('col0').(C) Print the result into the 'Translation Log' in the FME workbench.The code that I used is following:### USING FME TOOLS ###import fmeobjects, fmedef param_value(parameter_name): return fme.macr
I know we had to previously make sure FME Server was on the same server as ArcGIS. Is that still the case for new installs on a new server?
Dear FME community, Problem description: Attempting to run an inner table join between two tables using SQL within the FME PostGIS reader (i.e. under the "Format Parameters" tab in the "SELECT statement" form) does not output the correct number of records expected; in contrast to running the same query in the PgAdmin III Query window which outputs the expected number of records.Data: I use the Ordnance Survey (OS) AddressBase Premium data (EPOCH 36) which are stored in nine tables according to the OS documentation within a test environment PostGIS 9.4 database (localhost). A "geom" column including not null values and representing points is stored within the blpu table while the other tables although they have a "geom" column the values stored in them are null.SQL statement:SELECT DISTINCT dvp.uprn, dvp.dependent_locality, dvp.double_dependent_locality, blpu.geomFROM public.abp_delivery_point AS dvp, public.abp_blpu AS blpuWHERE dvp.uprn = blpu.uprn AND dvp.dependent_locality != ''Fe
Can someone help me with the best process for getting FME 2015 64-bit working with the ArcSDE30 reader?The process outlined in the knowledge base article on this issue (here) is rather cumbersome for a general FME user (one that isn’t also the SDE administrator).The knowledge base article calls for one to install the SDE SDK, however when I search the ESRI site I don’t see where I can get this.The only solution I could find was to download and install the ArcGIS Server for Windows software on my local PC. I was lucky enough that I’m high enough in my organization to have access to the ESRI downloads for their products, otherwise I wouldn’t have been able to do this.Does ESRI still make the SDE SDK?If so where is the download for it? Is there a plan to make this more streamlined with FME 2016?I would think that ArcGIS Pro would have the 64-bit DLL’s that FME needs so maybe you all could plug into that instead of requiring this rather hard to find install.
I would like to write a text file and put the information on multiple lines using the CSV writer. I see how to put multiple fields but I cannot find how to put my information on multiple lines.Thanks for your help!
I am facing a problem related to Arabic text visualization in Geodatabase after translation of data from (Oracle10g [Solaries])ArcSDE to geodatabase . Even in source oracle database showing the arabic attributes but after translation it dosn't. In place of real context these are showing string of "¿¿¿¿¿¿¿¿"
Hello,I am trying to write an 8bit DEM to a GeoTIFF. The output is supposed to have 2 bands. One gray or UINT8 and the other is an alpha8 band.The problem is that the GeoTIFF writer seems to be refusing the write out the alpha8. It keeps converting to UINT8. When I feed the output from my last transformer (before the writer) into the inspector the output looks exactly as it should and both bands are there. However when I actually inspect the written dataset, the gray8 is there as expected but the alpha8 is converted to UINT8.System:Desktop version is 2015.1. I have also tried this on 2014.Windows 7Any help is greatly appreciated.Nenad K.
Hello, i have a shape file with attributes and i would like to extract a any features but i dont want to use the transformer Tester. I know that Database has the option on the Navigator Painel that is able to make this action: Where Clause.But to Shapefile? existing?Or use python on Navigator configuration Startup Python Script.Thanks
Other than manually specifying coordinates to define a GDB reader's bounding box within workbench, is there a way to use (for example) a polygon to define the bounding box prior to reading so that a workspace can do this automatically and dynamically? I have project areas all across Christchurch, NZ and being able to do this would be very helpful in only reading in select portions of a massive city-wide dataset.Thanks,Chris
how to transform osm shapefiles to 3d cityGML or CAD files
CAT reader works well based on field properties and field boundaries set in Parameters window.I'm facing the following issue:1. I re-access the Parameters (Update Feature Types) and change the field boundaries (e.g. adding new fields with the ruler).2. After Update Feature Types the Feature Type properties / User Attributes (Name, Type, width) are according the changed parameters.3. When running the workspace (no transformers are added, only an Inspector is connected to the reader) , the new fields are shown in the table view of the inspector but without content. Furthermore the content is placed in the fields as before.Does updating CAT feature types need additional parameters I'm not aware of? Or is it a bug(I tried FME 2015.0 and FME 2016 Beta)Thanks for any hintKlaus
I have a workspace the writes to an excel file based off an excel template. The template has all of the rows set to filtered. How can I get the final output to include the filtered rows so I don't have to apply the filter every time I open the generated workbook?
Hi guys,I have a DWG file containing cadastre information. The entities are lines, polylines and arcs. I want to convert this file to a SQL Server spatial table. Before doing that, I inspected the file, and without doing any transformation, some arcs are being offset.Look at the example:In autocadIn FME Inspector:As you can see, there is a gap between line and arc edges. The DWG has no problem in Autocad, but many offsets like that in FME Inspector, without any transformation. The problem only seems to affect arcs.I am using FME Desktop 2015.1. Thank you,Maxime
Hello,I'm trying to convert a minecraft world to a pointcloud or a point shapefile.I manage to convert it to a .las file but the blockID and blockData are dropped during the writing.How can I keep these attributes?Cheers,
Related to writing 3D PDF:FME2014 – 32 bits: Option to «reorient 2D features for visibility»?FME2015 -64 BITS : No option to «reorient 2D features for visibility»?From the documentation I see:To maintain backwards compatibility:- Workspaces generated with 64-bit FME 2015+ use the PRC file format.- Workspaces generated before FME 2015, running 32-bit FME 2015 or later, will use the U3D file format.Is it not possible to use «reorient 2D features for visibility»? anymore?
hi, is it possible to make a published parametre for the table qualifier of postgis writer ?thx a lot for ur helphave a Nice day
Hello,I'm trying to add a element in my gml with 4 classes: restriction base="string"> <enumeration value="very good"/> <enumeration value="good"/> <enumeration value="medium"/> <enumeration value="bad"/>Can I do this in FME, because I only could add a parameter:So I want to change the type in order to have in my xsd file the several options:Thanks all for the support,regardsInês
I try to write multiple Raster images to a single PostGis table. Writing the records sequentially is working as designed.But I am using FME Cloud and want to write records parallel using multiple engines. The first record is written, but seems to lock the table. Therefor all other processes fail.How can I avoid the table lock in PostGis?Any suggestions?
Hi,I'm reading many LAS files in a workbench (FME 2015.1.2.1, 64 bits) and I don't undestand why I have this line in my log file for each of my LAS file:PointCloudThinner: Thinning point cloud from 2366939 point(s) to 50000 point(s)I don't use any pointcloudthinner in my workbench but it runs like if FME automatically reduce the number of point of my LAS file. If this is true, how can I control the parameter of that thinner?Thank youJulien
Hello everyone! I have an autocad file that contains anonymous blocks. I would like to be able to read them from FME 2013, meaning see autocad_block_name. In autocad, by going to quickselect, I see various block's name like: *U248, etc and I see on which layer these anonymous blocks are. In FME, I have to use schema reader to find the same layer, but I have no informations of the anonymous block's name. Can anyone help me? Thanks
I have a publication in FME Server that monitors a directory and sends a message to a topic when the contents of the directory change - for example, when a file gets updated. When I start the monitor for the topic in FME Server, I get this JSON output:Total: 1 Shown: 1 Test_DirWatch_Topic arrived at 7:40:03 { "ws_topic": "Test_DirWatch_Topic", "dirwatch_publisher_path": "C:\\\\ProgramData\\\\Safe Software\\\\FME Server\\\\Data\\\\xls\\\\New Text Document.txt", "dirwatch_publisher_content": "ENTRY_MODIFY C:\\\\ProgramData\\\\Safe Software\\\\FME Server\\\\Data\\\\xls\\\\New Text Document.txt", "dirwatch_publisher_action": "MODIFY", "fns_type": "dirwatch_publisher" }I also have am FME script that subscribes to the topic and takes action when the topic receives the JSON above. However, I only want the script to take action if the directory change is a "modify"
I am migrating ESRI shape file data to Smalword4.0 using FME. In migration process RWO objects migrated successfully. i am unable to migrate "Join Records"(Assets and Phases) and relation maintenance between tables. I need clear procedure to migrate join Records migration with relation maintenance.