Posts

Showing posts from October, 2017

JWPL

JWPL Bug: Bug:org.xml.sax.saxparseexception JAXP00010004 JWPL Debug: Copy this code in App.java package maven.maven; import javax.xml.XMLConstants; import javax.xml.parsers.ParserConfigurationException; import javax.xml.parsers.SAXParserFactory; import org.xml.sax.SAXNotRecognizedException; import org.xml.sax.SAXNotSupportedException; import de.tudarmstadt.ukp.wikipedia.datamachine.domain.JWPLDataMachine; public class App {     public static void main( String[] args ) throws SAXNotRecognizedException, SAXNotSupportedException, ParserConfigurationException     {          System.setProperty("jdk.xml.totalEntitySizeLimit", "500000000");         SAXParserFactory spf = SAXParserFactory.newInstance();        spf.setFeature(XMLConstants.FEATURE_SECURE_PROCESSING, false);         // Path where wiki dump is ...

Dataset: Comparable Corpus

Dumps Date: 20-09-2017 Arabic:  https://dumps.wikimedia.org/arwiki/20170920/ French:  https://dumps.wikimedia.org/frwiki/20170920/ English:  https://dumps.wikimedia.org/enwiki/20170920/ For each language, I downloaded the flowing files: [LAN]wiki-[DATE]-pages-articles.xml.bz2  [LAN]wiki-[DATE]-pagelinks.sql.gz  [LAN]wiki-[DATE]-categorylinks.sql.gz  [LAN]wiki-[DATE]-langlinks.sql.gz  [LAN]wiki-[DATE]-page.sql.gz  [LAN]wiki-[DATE]-redirect.sql.gz ISO 639-2 language code Wikipedia Main Category Name Wikipedia Disambiguation Category Name