1
0
Fork 0
Commit Graph

31 Commits

Author SHA1 Message Date
nemunaire 84fef789b5 Ignore decoding error when charset is erroneous
continuous-integration/drone/push Build is passing Details
2023-05-23 09:20:21 +02:00
nemunaire f1da640a5b tools/web: fix isURL function 2018-09-25 20:42:51 +02:00
nemunaire 53fe00ed58 tools/web: new function to retrieve only headers 2018-08-30 12:59:55 +02:00
nemunaire 4a636b2b11 tools/web: follow redirection in URLConn 2018-08-30 12:59:28 +02:00
nemunaire 5578e8b86e tools/web: split getURLContent function 2018-08-30 11:32:59 +02:00
nemunaire 1dae3c713a tools/web: new option to remove callback from JSON files 2017-09-19 07:25:33 +02:00
nemunaire dcb44ca3f2 tools/web: new parameter to choose max content size to retrieve 2017-09-19 07:25:33 +02:00
nemunaire 171297b581 tools/web: new option decode_error to decode non-200 page content (useful on REST API) 2017-08-23 21:13:39 +02:00
nemunaire 3267c3e2e1 tools/web: display socket timeout 2017-08-23 21:13:39 +02:00
nemunaire 0be6ebcd4b tools/web: fill a default Content-Type in case of POST 2017-07-19 10:36:26 +02:00
nemunaire b4218478bd tools/web: improve redirection reliability 2017-07-19 10:36:26 +02:00
nemunaire 6ac9fc4857 tools/web: forward all arguments passed to getJSON and getXML to getURLContent 2017-07-19 10:36:26 +02:00
nemunaire 8b4f08c5bd Replace IRCException by IMException, as nemubot is not only built for IRC 2015-11-03 07:21:06 +01:00
nemunaire 5141a0dc17 tools/web: simplify regexp and typo 2015-10-27 23:05:38 +01:00
nemunaire 56c43179f3 tools/web: use core xml minidom instead of nemubot xml parser 2015-10-27 23:04:54 +01:00
nemunaire 3004c01db4 tools/web: set timeout to 7 secs 2015-10-19 17:15:42 +02:00
nemunaire fd99deed1d tools/web: colon char in URL precedes optional // 2015-10-15 19:26:09 +02:00
nemunaire 55e6550cb1 tools/web: factorize getNormalizedURL 2015-10-13 16:23:55 +02:00
nemunaire 20105e7d98 tools/web: add a URL normalizer function 2015-10-12 13:10:58 +02:00
nemunaire 04dcf07fb2 tools/web: use standard unescape instead of custom function when available 2015-10-09 17:56:34 +02:00
Max c55e66dd70 [tools/web] Add header param to getContentUrl()
Add the possibility to specify headers when querying websites.
2015-10-08 02:47:42 +01:00
nemunaire 760da8ef61 tools.web: don't try to striphtml content that is not str or buffer 2015-09-24 11:29:47 +02:00
nemunaire 9b2bc27374 tools.web: restore Python3.3 behavior: don't check server certificate 2015-09-24 11:29:46 +02:00
nemunaire 8988dd0d41 striphtml: also convert ´ and collapse multiple space, as HTML display do 2015-09-24 11:29:46 +02:00
nemunaire c27540eb87 web: reduce timeout from 15 to 7 seconds 2015-08-26 12:18:23 +02:00
nemunaire 88a8e0fe59 web: can make POST request 2015-08-26 12:18:23 +02:00
nemunaire 787a5fd3da Web tool raise more IRCException 2015-08-26 12:17:21 +02:00
nemunaire fc500bc853 Tools.Web: fix charset detection on webpages 2015-06-03 15:30:26 +02:00
nemunaire e588c30044 Optimize imports 2015-05-25 16:44:16 +02:00
nemunaire 5a6230d844 [wip] changes import to reflect new directory structure 2015-01-05 02:48:49 +01:00
nemunaire 41f7dc2456 [wip] move files in order to have a clean directory structure 2015-01-04 15:14:35 +01:00