Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 7,085 Posts
  • 26,094 Replies
7085 Posts
A
ashish_m1
asked in Data
how to remove xmlns:xlink from header in GML writer?

Hi,I am producing GML files from FME, but the writer automatically includes xmlns:xlink="http://www.w3.org/1999/xlink" attribute on gml:FeatureCollection element.Can I remove this attribute from writer?Thanks,Ashish

320
A
ottadini
Supporter
ottadiniSupporter
asked in Data
Temporary network path mapping (Windows)

Some UNC paths are very long (\\global\analysis\more\another\and\so\on\...), so it might be necessary to map the very long path to a drive letter for example. How can I do this and retain transportability across Windows platforms, and maybe other platforms?At the moment I use a SystemCaller, and simply assign a drive letter I pick to the UNC path, e.g., SUBST X: \\global\analysis\etc\.But, this is possibly going to be wrong at some stage, when X: is assigned by the admins without warning, well, maybe. In Windows there are various ways to get the next unused drive letter, one of which is PUSHD \\global\analysis\etc\but, then how do I get the drive letter that is assigned, using the system caller?Or, is there another way?

452
david_r
Celebrity
A
Anonymous
asked in Data
Strip HTML From Text

Is there a transformer for stripping HTML from text? I see the HTMLStripper, but it appears to replace HTML with XML. I want all HTML tags removed, including the <!DOCTYPE html>.Thanks

2970
jdh
Contributor
P
philippe33
asked in Data
How to update an XML File with another one

Hi,I have two xml files, the first one is made with these informations:The second one is made with these information : My problem follows:1 - I have to put the element <TIMSH> present in the second file in the first file at the same place (same <ASE id>. How can i proceed (for 1 <TIMSH>)2 - I can have many elements <TIMSH> present in the second file for one <ASE id> and i have to update them in the first file at the same place. How to proceed ? (many <TIMSH> to update)3 - The tree structure is : <ASE><ATT><TIMSH>Thanks for your help

310
takashi
Celebrity
nielsgerrits
VIP
nielsgerrits
asked in Data
FME server path handling

Dear community, I have difficulties understanding the behavior of server handling (unc) paths. I'm quite new to server so this one might be simple but I don't get it.What I want to do is use a Directory Watch publication on a upload folder. Then let a workbench subscription react to a new upload. This works. I need the workbench directory file and pathnames reader to scan the upload folder, add the new files to a list and move the files to a queue folder.This is where the trouble comes in. The log tells me that the folder is not found. But the path is not the path I defined (\\\\fc01\\FMEdata\\KLIC\\upload) but local (D:\\Program Files\\FMEServer\\repositories\\KLIC\\01_scan\\upload).When I create the path dynamic (datapath = \\\\fc01\\FMEdata\\KLIC, dataset = @Value(datapath)\\upload) things works fine. So I got it working but I do not understand why... Can anyone give me a hint in the right direction?I know for sure server has read/write acces to this path as I have no proble

580
nielsgerrits
VIP
M
mhammond
asked in Data
Salesforce Writer appears to be stopping after 200 records

I have a transformation from Oracle Non Spatial to Salesforce that works fine until there are more than 200 records. At that point it errors. I can't tell from the error message what the issue is exactly. Is it some setting in Salesforce? Do I not have the parameters set correctly on my Reader/Writer? Any help would be appreciated. I do know that the records after 200 do not have data issues as I can write them only not when they are greater than feature 200.Salesforce Writer: Record 201 was not processed successfully: 'CANNOT_INSERT_UPDATE_ACTIVATE_ENTITY:InternalServiceOrderTrigger: execution of AfterUpdate caused by: System.NullPointerException: Attempt to de-reference a null object Class.InternalServiceOrderTriggerHandler.emailRelatedServiceOrderSDC: line 668, column 1 Class.InternalServiceOrderTriggerHandler.triggerHandler: line 93, column 1 Trigger.InternalServiceOrderTrigger: line 4, column 1:--'

50
M
M
michaeltfl
asked in Data
CAD to Excel

I'm still quite new and struggling on the first hurdle, any help anyone could provide would be much appreciated. I have a CAD (DWG) file with multiple Layers. The Layers contain settings such as Linetype, Lineweight, colour etc. I would like to get the Layer setting out to and Excel spreadsheet.I've opened a CAD file, exposed only the relevant Layer attributes but nothing seems to flow through to the transformers or even into an inspector.

11316
M
G
greenroze
asked in Data
Excel Writer output name dynamic define

Hello, is it possible to write date to Excel dynamically (as it happends with Shape-file)? Without writing the Name of the output at the begin? I wonder if there is any Workaround to do it? In my case i Need to write Information in different Excel-Files with the Name of variable (depends on class of the data).

1450
G
zzupljanin
Contributor
zzupljaninContributor
asked in Data
Explode hatch

Hi,this might be odd question but here it goes:Is it possible to explode hatch paterns to its geometries. For example, if some polygon is hatched with horizontal lines can I get those lines?Thank you.

170
david_r
Celebrity
M
mattdoa2
asked in Data
Accessing FME_MacroValues['FME_JOB_ID']

I'm trying to figure out how to access the FME_MacroValues['FME_JOB_ID'] system parameter.  I'm trying to link this script to a writers destination. Basically want to include the job ID in the file name of the output. I've attempted this using the code below but am getting the error shown in this log:Starting translation...INCLUDE -- failed to evaluate Python script `def ParamFunc():  import fme  return '\\\\ServerLocation\\logging\\failed_logs\\' + 'failed_load_' + FME_MacroValues['FME_JOB_ID'] + '.xlsx'value = ParamFunc()macroName = 'DestDataset_XLSXW2'if value == None:  return { macroName : '' }else:  return { macroName : str(value) }'Program TerminatingTranslation FAILED.Traceback (most recent call last):  File "<string>", line 5, in MF_Include_1490921734471  File "<string>", line 4, in ParamFuncKeyError: 'FME_JOB_ID'This is the python code:import fmereturn '\\ServerLocation\\logging\\failed_logs\\' + 'failed_load_' + FME_MacroValues['FME_JOB_ID'] + '.xlsx'

1325
takashi
Celebrity
gmbutler2
Contributor
gmbutler2Contributor
asked in Data
What transformers would I need to use to reference as the cell rotation angle in the dgnstyler?

I am using an aggregated object to insert a cell using the dgnstyler. The aggregated object has 2 geometries, a point and a line. I need to use the line as a reference for the angle of the cell rotation, but I do not know how to derive an angle for this line. Can someone help me find a way to do this?

70
fmelizard
Safer
K
katiem
asked in Data
Issue with using the XMLUpdater transformer to manipulate Metadata

I'm using the Esri Geodatabase (ArcSDE Geodb) reader with Feature Read Mode set to Metadata, to read in GEMINI metadata from SDE. I'd like to manipulate certain elements before sending the updated metadata back to the SDE feature class. Using the XMLUpdater I've been able to amend the content for some elements, however I haven't had any success when trying to amend the revision date, as there are three different date strings all with the same XML path: metadata/gmd:GEMINI_Metadata/gmd:identificationInfo/gmd:MD_DataIdentification/gmd:citation/gmd:CI_Citation/gmd:date/md:CI_Date/gmd:date/gco:DateCurrently none of them are getting updated on the output XML. The different date types are differentiated in the gmd:dateType element, e.g: <gmd:dateType> <gmd:CI_DateTypeCode codeList="http://standards.iso.org/ittf/PubliclyAvailableStandards/ISO_19139_Schemas/resources/Codelist/gmxCodelists.xml#CI_DateTypeCode" codeListValue="revision">Rev

310
itay
Supporter
A
angela
asked in Data
My readers are csv files with uniform # of commas in each row, but with no headings. And each file name is unique and needs to be made an attribute. Is there a way to add attribute names as I read in each file?

40
takashi
Celebrity
E
eltigre333
asked in Data
How to Extract Coordinates from Oracle Spatial Object Table

Hello, I've searched all available online sources but none appear to have this issue.Very simple task: I've added an Oracle Spatial Reader, connected to desired table and now want to extract x/y but I get this error when running."Error - Cannot have NULL value for 'z coordinate'"I've looked at the table in Oracle developer and indeed the Z values are Null.I'm aware that this table has multiple Spatial columns so I've checked: Handle Multiple Spatial Columns: YesI've tried a SELECT statement to run before translation:SELECT c.GEOM.SDO_POINT.X AS X, c.GEOM.SDO_POINT.Y AS Y,  FROM A.ENTITIES c  WHERE ACCESS_CODE = 'O'I've tried to expose the attributes: oracle_sdo_point.x oracle_sdo_point.y oracle_sdo_point.zIs there a way to force this to 2D rather than looking at the Z values?Any ideas appreciated. 

5330
E
tim_wood
Contributor
tim_woodContributor
asked in Data
Log says "fixed reader/writer config issues" loading Workspace - how do I find out what was fixed?

When loading a 2016.1 Workspace in 2017.0, I saw this in the Translation Log:Workbench: Workspace integrity check during load found one or more readers/writers with configuration issues.Workbench: Backed up current workspace as: X:\\Path\\Folder\\Wibble (backup).fmwWorkbench: Fixed reader/writer configuration issues.How can I find out what was wrong with the Reader/Writers?

50
tim_wood
Contributor
ciarab
Contributor
ciarabContributor
asked in Data
Generic Writer Autodesk AutoCAD DWG/DXF

Probably a simple solution to this but I can't seem to find it.If I have a generic writer and I want to write out to dwg or dxf how do I enforce it to write to dxf, it defaults to dwg . I have tried lots of things like creating a dummy writer for ACAD or creating an output published parameter with 2 options for the AutoCAD writer with 2 different values-- this works but if I select DWG or DXF I still get a dwg file.I can add a tester which sorts whether the end user selected DWG or DXF and then filters it into an ACAD writer that has the extension hardcoded..but I don't really want to do that when I feel like I have just missed something? Any help would be appreciated

330
ciarab
Contributor
R
robyn_studts
asked in Data
Text Node Linkages in Microstation

When translating text nodes into Microstation I have found that the linkage is not being created during the translation. Once the dgn is created I must select the text node and edit it before the linkage shows up. This is an issue when I need to project the data into a different coordinate system because the text nodes end up in a different location then everything else. Is there a way to have the linkage created during the translation process?

1570
gmbutler2
Contributor
M
mishenka
asked in Data
DGN IN AUTOCAD 2017.

I simply want to import a drawing from a client which has the DGN extension; into AUTOCAD 2017. It says " DGN must be in version 7 or 8" and closes the dialog with an error. This FME software is far too complex for such a mundane purpose. I can redraw the entire project in less time than it would take to learn software such as this. Does anyone know of a simple tool to convert non supported DGN files to AutoCad 2017?

130
C
hlouie
Contributor
hlouieContributor
asked in Data
File Properties, change created and modified by date

I have a directory of PDF files scanned in 1996, I have feature dataset linked by PDF filename the with another attribute field with correct document creation date. How can change the PDF filename properties of creation data?

963
hlouie
Contributor
N
nickcarsn
asked in Data
Issue mapping Oracle 11g database using schema mapper to a geodatabase

I'm having an issue using the schema mapper to remap the schema of a Oracle 11g database and write thte data into a file geodatabase using FME 2017.0.0.0 Build 17236. I have succesfully mapped the SQL Server version of the same schema and data with no problems. If I set up the Oracle mapping I can get it to map successfully but it will fail to output to the geodatabase and will automatically output to an .ffs file. I can then open up the .ffs file and everything is mapped properly, just not outputting to the right location. Any advice regarding this issue would be much appreciated.

60
erik_jan
Contributor
B
bas_boers
asked in Data
How to create a INSPIRE GML without the gml:boundedBy-tag

Hi, I'd like to create a inspire GML-file (using the inspire GML writer) without the <gml:boundedBy>-tag. <gml:boundedBy> <gml:Envelope srsName="EPSG:28992" srsDimension="3"> <gml:lowerCorner>96465.102 471796.29 0.00</gml:lowerCorner> <gml:upperCorner>145855.225 563146.105 0.00</gml:upperCorner> </gml:Envelope> </gml:boundedBy>Is there a way to generate such a zipped gml (with the INSPIRE gml writer) without the above text/tag. How do I prevent my workbench from generating this tag. Thanks in advance.Bas Boers

240
deanatsafe
Safer
courtney_m
Contributor
courtney_mContributor
asked in Data
Updating SDE Feature Classes That Are Involved in a Relationship Class

I have a series of workspaces that sync an Oracle Database with an SDE database every hour (ORACLE_SPATIAL and GEODATABASE_SDE Readers > GEODATABASE_SDE Writer). I created several relationship classes in the SDE database (via ArcCatalog), and now my workspace fails to update any of the feature classes that are involved in a relationship class.I am receiving the following error: Error while retrieving an ArcObjects update cursor for the table/feature class 'DBO.EL_SERVICE_POINT'. The error number from ArcObjects is: '-2147216556'. The error message from ArcObjects is: {Objects in this class cannot be updated outside an edit session}If I delete the relationship classes, the Feature Types update as expected.I tried setting geodb_feature_has_relationships to 'yes' before writing to SDE, but I still received the same error.Also, the Transaction Type on the SDE reader and writer is set to "Versioned Edit Session", as I am updating a versioned SDE databa

1560
courtney_m
Contributor
K
kamyabshabrandi
asked in Data
i have i esri map doc shown in the pic blue bold lines has complex edge geometry an e specefic id and blue triangular points has their own spec id now i want retive blue triangular points and bold line id into dashed lines

60
K
S
stuartohara
asked in Data
Can I use attributes from a shape file grid to name my raster writer output files?

Hi All,I need to automate the process of cutting up an image file into approximately into 11,500 separate images.I have my image file. I have my grid shape file that contains attributes that I want to use as my output image file names.I can get image outputs using clipper that are exactly as I expect (correct dimensions etc) but cannot figure out how to name them correctly.I'm convinced that I'm missing something quite simple here.I have been searching through the knowledge center but can't find exactly what I'm looking for.Has anyone had experience with this? I'm using FME Desktop 2015

170
S
B
barbara
asked in Data
Timeout / Postgis-Writer

Hi ,is it possible to set a timeout-Parameter for writing in a Postgis-DB to ensure, that the connection will be closed.

120
B

Badge Winners

  • FME Form Basic Training
    dezuviriamhas earned the badge FME Form Basic Training
  • Welcome Back
    dwade10has earned the badge Welcome Back
  • Integrate Data with the FME Platform Training
    johnrochehas earned the badge Integrate Data with the FME Platform Training
  • Student (Grey)
    westerbrinkhas earned the badge Student (Grey)
  • Teacher (Grey)
    westerbrinkhas earned the badge Teacher (Grey)
Show all badges

Community Stats

31,798
Posts
120,793
Replies
39,417
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.