WikklyText - Home

WikklyText has moved!


Beginning with the release of WikklyText 1.0, it is now hosted at wikklytext.com. I think this will be a better location than having it scattered throughout the pages here. wikklytext.com runs a WikklyText wiki (behind Apache) which is nice for demonstration purposes as well.

Comments

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

unicode problems with twextract?

Hello, I'm looking forward to this tool! However, I'm getting errors when trying to run twextract - it looks like this is a unicode / character set problem? I'm running this on a debian etch system. I believe by default etch tries to use UTF-8... Error dump:

Traceback (most recent call last): File "/usr/bin/twextract", line 7, in ? sys.exit( File "/usr/lib/python2.4/site-packages/WikklyText-0.99.50-py2.4.egg/wikklytext/scripts/twextract.py", line 351, in do_main print "Got %d names" % len(istore.names()) File "/usr/lib/python2.4/site-packages/WikklyText-0.99.50-py2.4.egg/wikklytext/store/wikStore_tw.py", line 39, in names self.ensure_cache() File "/usr/lib/python2.4/site-packages/WikklyText-0.99.50-py2.4.egg/wikklytext/store/wikStore_tw.py", line 64, in ensure_cache for item in self.store.getall(): File "/usr/lib/python2.4/site-packages/WikklyText-0.99.50-py2.4.egg/wikklytext/store/wikStore_tw_re.py", line 130, in getall return [self.parse_div(div) for div in self.get_all_divs()] File "/usr/lib/python2.4/site-packages/WikklyText-0.99.50-py2.4.egg/wikklytext/store/wikStore_tw_re.py", line 339, in get_all_divs return self.get_store().split('</div>')[:-1] File "/usr/lib/python2.4/site-packages/WikklyText-0.99.50-py2.4.egg/wikklytext/store/wikStore_tw_re.py", line 326, in get_store buf = self.loadfile() File "/usr/lib/python2.4/site-packages/WikklyText-0.99.50-py2.4.egg/wikklytext/store/wikStore_tw_re.py", line 271, in loadfile return unicode(buf, 'utf-8') UnicodeDecodeError: 'utf8' codec can't decode byte 0xbb in position 12358: unexpected code byte

Thanks for any pointers,

Nathan
Written in WikklyText.

twextract & unicode

It should auto-detect the encoding and handle it correctly, so that's probably a bug if it didn't. Do you have a sample wiki I can download and test this?

unicode issue?

Hi,

It's probably overkill, but you can use

http://fiveprime.org/index.html (my home page)

as an example. Perhaps a tarred version would also be of value?

http://fiveprime.org/index.html.tgz

Thanks, Nathan

unicode issue

Thanks, I was able to reproduce the issue (in fact your site is a pretty good stress test ... I found a couple more problems as well). WikklyText 1.0 should be out soon with these fixes.

Hello, Can this run on

Hello, Can this run on Windows as well?

Cheers

Windows

Yes, I develop primarily under Windows and Linux. In the next release I'm going to provide binaries for Windows to make it even easier.

pkg_resources

I type twextract and get an error, telling me

C:\Documents and Settings\infinitelink>twextract Traceback (most recent call last): File "C:\Python25\Scripts\twextract-script.py", line 5, in <module> from pkg_resources import load_entry_point ImportError: No module named pkg_resources


and I wonder ???

It says that using the installer we have to install dependencies...I'm guessing that's it. However what dependency? Where do I get it? How? etc...and why would it be the installer that needed dependencies? If I gave an "installer" with this shortcoming it would rather be one that defaulted a directory to C: and then simply worked as auto-sourced unpacked and ran python setup.py install, and then added the variable to the PATH.

ANYways, thanks for the great work! I await any help.

pkg_resources

Hm, that's strange. pkg_resources is part of setuptools, but everything should be setup to auto-download the dependencies (unless I messed something up!). Try installing setuptools yourself and see if that fixes it.

WikklyText

WikklyText has been featured at LinuxLinks.com - the Linux Portal Site.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

Post new comment

The content of this field is kept private and will not be shown publicly.