1
0
Fork 0
Commit Graph

60 Commits

Author SHA1 Message Date
nemunaire 84fef789b5 Ignore decoding error when charset is erroneous
continuous-integration/drone/push Build is passing Details
2023-05-23 09:20:21 +02:00
nemunaire 85c418bd06 feed: fix RSS link handling 2019-02-03 12:59:17 +01:00
nemunaire f1da640a5b tools/web: fix isURL function 2018-09-25 20:42:51 +02:00
nemunaire 53fe00ed58 tools/web: new function to retrieve only headers 2018-08-30 12:59:55 +02:00
nemunaire 4a636b2b11 tools/web: follow redirection in URLConn 2018-08-30 12:59:28 +02:00
nemunaire 72bc8d3839 feed: accept RSS that begins with <rss> tag 2018-08-30 12:54:06 +02:00
nemunaire 5578e8b86e tools/web: split getURLContent function 2018-08-30 11:32:59 +02:00
nemunaire 125ae6ad0b feed: fix RSS parsing 2018-06-06 14:50:45 +02:00
nemunaire 8a25ebb45b xmlparser: fix parsing of subchild 2018-06-06 14:50:45 +02:00
nemunaire 4cd099e087 xmlparser: make DictNode more usable 2018-01-14 19:19:02 +01:00
nemunaire 1dae3c713a tools/web: new option to remove callback from JSON files 2017-09-19 07:25:33 +02:00
nemunaire dcb44ca3f2 tools/web: new parameter to choose max content size to retrieve 2017-09-19 07:25:33 +02:00
nemunaire ce012b7017 datastore/xml: handle entire file save and be closer with new nemubot XML API 2017-09-19 07:25:32 +02:00
nemunaire 39056cf358 tools/xmlparser: implement writer 2017-08-23 21:13:39 +02:00
nemunaire 171297b581 tools/web: new option decode_error to decode non-200 page content (useful on REST API) 2017-08-23 21:13:39 +02:00
nemunaire 3267c3e2e1 tools/web: display socket timeout 2017-08-23 21:13:39 +02:00
nemunaire 0be6ebcd4b tools/web: fill a default Content-Type in case of POST 2017-07-19 10:36:26 +02:00
nemunaire b4218478bd tools/web: improve redirection reliability 2017-07-19 10:36:26 +02:00
nemunaire 6ac9fc4857 tools/web: forward all arguments passed to getJSON and getXML to getURLContent 2017-07-19 10:36:26 +02:00
nemunaire 7cf73fb84a Remove reload feature
As reload shoudl be done in a particular order, to keep valid types, and because maintaining such system is too complex (currently, it doesn't work for a while), now, a reload is just reload configuration file (and possibly modules)
2017-07-16 21:17:48 +02:00
nemunaire 2c3d61495f Welcome in 2016... Happy new year! 2016-04-08 12:55:24 +02:00
nemunaire 57c460fc9c Simplify date extraction 2015-12-23 12:50:25 +01:00
nemunaire cd0dbc4cc2 Xmlparser: parser for lists and dicts 2015-12-21 14:50:48 +01:00
nemunaire d59f629dd9 Xmlparser: new class that just store one node, futher nodes will be parsed 2015-12-21 14:50:48 +01:00
nemunaire c06fb69c8b Extract tools.config as config module 2015-11-03 16:53:49 +01:00
nemunaire c6aa38147b Include some forgotten module in reload process 2015-11-03 07:21:49 +01:00
nemunaire 8b4f08c5bd Replace IRCException by IMException, as nemubot is not only built for IRC 2015-11-03 07:21:06 +01:00
nemunaire ac33ceb579 Remove dead or useless code 2015-11-03 07:20:52 +01:00
nemunaire e4d67ec345 Use Channel class when creating Server 2015-10-29 15:25:54 +01:00
nemunaire 2fdef0afe4 addChild should return a boolean 2015-10-28 10:55:03 +01:00
nemunaire c560e13f24 Rework XML parser: part 1
This is the first step of the parser refactoring: here we change
	the configuration, next step will change data saving.
2015-10-28 10:55:02 +01:00
nemunaire 5141a0dc17 tools/web: simplify regexp and typo 2015-10-27 23:05:38 +01:00
nemunaire 56c43179f3 tools/web: use core xml minidom instead of nemubot xml parser 2015-10-27 23:04:54 +01:00
nemunaire a4fd04c310 Remove print unhandled in daemon mode 2015-10-20 18:02:01 +02:00
nemunaire 3004c01db4 tools/web: set timeout to 7 secs 2015-10-19 17:15:42 +02:00
nemunaire fd99deed1d tools/web: colon char in URL precedes optional // 2015-10-15 19:26:09 +02:00
nemunaire 55e6550cb1 tools/web: factorize getNormalizedURL 2015-10-13 16:23:55 +02:00
nemunaire 20105e7d98 tools/web: add a URL normalizer function 2015-10-12 13:10:58 +02:00
nemunaire 7102e08000 tools/feed: hardened parser 2015-10-10 23:20:52 +02:00
nemunaire 04dcf07fb2 tools/web: use standard unescape instead of custom function when available 2015-10-09 17:56:34 +02:00
Max c55e66dd70 [tools/web] Add header param to getContentUrl()
Add the possibility to specify headers when querying websites.
2015-10-08 02:47:42 +01:00
nemunaire a4f4bb799c Extract atom from networking module to core 2015-09-28 11:53:29 +02:00
nemunaire 760da8ef61 tools.web: don't try to striphtml content that is not str or buffer 2015-09-24 11:29:47 +02:00
nemunaire 9b2bc27374 tools.web: restore Python3.3 behavior: don't check server certificate 2015-09-24 11:29:46 +02:00
nemunaire 8988dd0d41 striphtml: also convert ´ and collapse multiple space, as HTML display do 2015-09-24 11:29:46 +02:00
nemunaire 9686f36522 Add a function to guess the closest word for a miss input 2015-09-24 11:29:44 +02:00
nemunaire e837f9c8e5 Improve formating of size function and test it 2015-09-24 11:29:43 +02:00
nemunaire 2b0593a51e Add tool to calculate string distance 2015-09-23 18:06:21 +02:00
nemunaire c27540eb87 web: reduce timeout from 15 to 7 seconds 2015-08-26 12:18:23 +02:00
nemunaire 88a8e0fe59 web: can make POST request 2015-08-26 12:18:23 +02:00