fdroidserver/fdroidserver
Hans-Christoph Steiner 117d63cca5 update: use 'replace' mode to handle non-UTF8 description files
Fastlane/Triple-T app store metadata files must be in UTF-8.  Before this
would crash if they were not.  This changes the handling to just replace
the non-UTF8 chars with a �.  Here's the stacktrace:

CRITICAL: Unknown exception found!
Traceback (most recent call last):
  File "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroid", line 164, in <module>
    main()
  File "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroid", line 159, in main
    raise e
  File "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroid", line 138, in main
    mod.main()
  File "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroidserver/update.py", line 2010, in main
    insert_localized_app_metadata(apps)
  File "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroidserver/update.py", line 885, in insert_localized_app_metadata
    os.path.join(root, f))
  File "/var/lib/jenkins/userContent/reproducible/reproducible_fdroid_build_apps/fdroidserver/update.py", line 700, in _set_localized_text_entry
    text = fp.read()[:limit]
  File "/usr/lib/python3.5/codecs.py", line 321, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xfc in position 94: invalid start byte
2018-10-19 15:06:16 +02:00
..
asynchronousfilereader Add asynchronous filereader, fix python3 lockups 2015-09-20 20:57:53 +02:00
__init__.py fix egg-link and easy_install support for Python3 2017-10-19 23:28:13 +02:00
btlog.py use defusedxml to avoid DoS attacks while loading XML 2018-08-29 17:44:54 +02:00
build.py build: reuse common methods for getting metadata from APKs 2018-09-18 10:55:51 +02:00
checkupdates.py checkupdates: remove magic number 99999999 from HTTP checks 2018-08-29 17:24:24 +02:00
common.py remove redundant open() arg: encoding='utf8' 2018-10-19 15:01:34 +02:00
dscanner.py fix PEP8: W504 line break after binary operator 2018-05-29 12:31:56 +02:00
exception.py checkupdates: don't fail when we can't init submodules 2017-12-04 16:30:37 +01:00
gpgsign.py implement gettext localization 2017-09-15 11:39:00 +02:00
import.py import: ensure categories from CLI flag are always a list 2018-10-11 11:59:42 +02:00
index.py convert apkcache from pickle to JSON 2018-09-03 18:07:40 +02:00
init.py remove redundant open() arg: encoding='utf8' 2018-10-19 15:01:34 +02:00
install.py fix string formats that are ambiguous for translators 2017-09-16 13:19:38 +02:00
lint.py lint: check fields for proper type, e.g. list vs. string 2018-10-09 23:31:24 +02:00
metadata.py remove redundant open() arg: encoding='utf8' 2018-10-19 15:01:34 +02:00
mirror.py mirror: fix syntax error on Python 3.4 2017-11-30 14:03:04 +01:00
net.py Support ETag when downloading repository index 2017-05-02 15:37:02 -03:00
nightly.py fix typos in strings 2018-09-24 17:09:15 +02:00
publish.py mark all required usages of MD5 so bandit doesn't complain 2018-08-29 17:44:54 +02:00
readmeta.py all: make newer pycodestyle happy 2016-11-15 20:55:06 +00:00
rewritemeta.py remove redundant open() arg: encoding='utf8' 2018-10-19 15:01:34 +02:00
scanner.py remove redundant open() arg: encoding='utf8' 2018-10-19 15:01:34 +02:00
server.py mark all required usages of MD5 so bandit doesn't complain 2018-08-29 17:44:54 +02:00
signatures.py clean up globals in signatures.py 2018-07-30 13:07:07 +02:00
signindex.py implement gettext localization 2017-09-15 11:39:00 +02:00
stats.py fix PEP8 W605 invalid escape sequence 2018-05-29 13:51:47 +02:00
tail.py remove redundant open() arg: encoding='utf8' 2018-10-19 15:01:34 +02:00
update.py update: use 'replace' mode to handle non-UTF8 description files 2018-10-19 15:06:16 +02:00
verify.py fix "local variable 'e' is assigned to but never used" 2018-05-25 12:32:34 +02:00
vmtools.py Merge branch 'use_available_buildserver_box' into 'master' 2018-09-18 08:52:51 +00:00