Integrating reading-level calculators

<oXygen/> general issues.
bburns
Posts: 12
Joined: Mon Jun 19, 2017 11:24 pm

Integrating reading-level calculators

Post by bburns » Sat Sep 16, 2017 12:45 am

For various reasons that I won't go into here, we need to generate reading levels for our publications. This has to be done at the map level as there needs to be enough text to get a "reliable" score. I see that it's possible to integrate external tools via Tools >External Tools > Configure...

Has anyone integrated an external reading-level calculator using this approach or some other?

Thanks in advance.
Bill Burns
Content Architect | Healthwise
bburns@healthwise.org | www.healthwise.org
208.331.6917 (office) | 208.345.1897 (fax)

Healthwise helps people make better health decisions.

Radu
Posts: 6498
Joined: Fri Jul 09, 2004 5:18 pm

Re: Integrating reading-level calculators

Post by Radu » Mon Sep 18, 2017 10:37 am

Hi Bill,

Interesting, honestly did not know that such tools existed.
The problem would be that the external tool would have access to the DITA Map but it would need access to a resolved DITA Map, with all conrefs and topicrefs expanded.
How about if on the DITA Map root element you set the chunk="to-content" attribute and then publish the XHTML so that a single very large HTML document is obtained? After this you can open the HTML in a web browser and copy the content from it...
Or at some point Jarno Elovirta created a plugin which outputs plain text from a DITA Map com.github.dita-ot-plugins.plaintext:

https://github.com/jelovirt/dita-ot-plugins

So I think it would be feasible to creating a DITA Open Toolkit plugin which first obtains all the text from the DITA Map and then calls an external process to score it. For example I created some time ago a DITA OT plugin which generates a single merged DITA file from the original DITA project:

https://github.com/oxygenxml/dita-merged

Applying an XSLT stylesheet which only extracts the text from that file and then calling an external process to score the text should work.

What scoring tool were you planning to use?

Regards,
Radu
Radu Coravu
<oXygen/> XML Editor
http://www.oxygenxml.com

bburns
Posts: 12
Joined: Mon Jun 19, 2017 11:24 pm

Re: Integrating reading-level calculators

Post by bburns » Wed Jan 23, 2019 11:11 pm

We're using Flesch-Kincaid, but we've looked recently at other indexes that seem to provide more reliable results. We have a process that runs on both maps and topics, but really only the map reading level is useful. Just trying to determine how we might implement this in Oxygen to work as it did in our previous editor.
Bill Burns
Content Architect | Healthwise
bburns@healthwise.org | www.healthwise.org
208.331.6917 (office) | 208.345.1897 (fax)

Healthwise helps people make better health decisions.

Radu
Posts: 6498
Joined: Fri Jul 09, 2004 5:18 pm

Re: Integrating reading-level calculators

Post by Radu » Fri Jan 25, 2019 11:02 am

Hi Bill,

Maybe you could give me more details about how this used to work in your previous editing solution.

Regards,
Radu
Radu Coravu
<oXygen/> XML Editor
http://www.oxygenxml.com

Post Reply
https://www.oxygenxml.com/forum/topic14927.html
www.oxygenxml.com
crawl=CC-MAIN-2019-43
52239
application/http; msgtype=response
sha1:RPUQ2FVXCDPLYBUL7IDI74LTPWN3AL5H
<urn:uuid:c21c9d7a-716b-4286-ab89-f70785f27928>
2019-10-14T08:13:44Z
52.38.177.216
text/html
sha1:X6QQA6CBKR7M6CK3F74AIVH56UEFXTZH
<urn:uuid:98eba2c3-34b2-4a5f-aafa-89a30f5a12a9>
https://www.oxygenxml.com/forum/topic14927.html
response
<urn:uuid:c5d93825-2021-4211-8feb-3a88ee41e68a>
isPartOf: CC-MAIN-2019-43
publisher: Common Crawl
description: Wide crawl of the web for October 2019
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-104.ec2.internal
software: Apache Nutch 1.16 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/