Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 1 | Medium-long term roadmap - 2010/04/10 |
willy tarreau | 814cbc6 | 2006-05-13 13:00:29 +0200 | [diff] [blame] | 2 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 3 | Legend: '+' = done, '-' = todo, '*' = done except doc |
willy tarreau | 814cbc6 | 2006-05-13 13:00:29 +0200 | [diff] [blame] | 4 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 5 | 1.5 (ETA 2010/12/31) : |
| 6 | - server-side HTTP keepalive |
willy tarreau | 814cbc6 | 2006-05-13 13:00:29 +0200 | [diff] [blame] | 7 | |
Willy Tarreau | 0a6b1fd | 2010-11-14 14:23:22 +0100 | [diff] [blame^] | 8 | - POST parameter extraction |
| 9 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 10 | - return-html code xxx [ file "xxx" | text "xxx" ] if <acl> |
willy tarreau | 1f431b5 | 2006-05-21 14:46:15 +0200 | [diff] [blame] | 11 | |
Willy Tarreau | 0a6b1fd | 2010-11-14 14:23:22 +0100 | [diff] [blame^] | 12 | - avg connect time, response time, connect errors, response errors in stats |
| 13 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 14 | - return-raw [ file "xxx" | text "xxx" ] if <acl> |
willy tarreau | 814cbc6 | 2006-05-13 13:00:29 +0200 | [diff] [blame] | 15 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 16 | - add support for client-side and server-side unix sockets |
willy tarreau | 38d7906 | 2006-05-21 14:47:13 +0200 | [diff] [blame] | 17 | |
Willy Tarreau | 0a6b1fd | 2010-11-14 14:23:22 +0100 | [diff] [blame^] | 18 | - have multi-criteria analysers which subscribe to req flags, rsp flags, and |
| 19 | stream interface changes. This would result in a single analyser to wait |
| 20 | for the end of data transfer in HTTP. |
| 21 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 22 | - try to remove srv==NULL internally and assign a dummy server to each backend |
| 23 | for dispatch, http_proxy and transparent modes. |
willy tarreau | 814cbc6 | 2006-05-13 13:00:29 +0200 | [diff] [blame] | 24 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 25 | - implement support for "connection freeze" after accept. A list of frozen |
| 26 | connections should be maintained so that it is possible to recycle them |
| 27 | when new file descriptors are required. |
Willy Tarreau | 1c47f85 | 2006-07-09 08:22:27 +0200 | [diff] [blame] | 28 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 29 | - support for time-ordered priority queues with ability to add an offset |
| 30 | based on request matching. Each session will have one ebtree node to be |
| 31 | attached to whatever queue the session is waiting in. |
Willy Tarreau | 1c47f85 | 2006-07-09 08:22:27 +0200 | [diff] [blame] | 32 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 33 | - assign a nice priority based on ACLs. |
Willy Tarreau | baaee00 | 2006-06-26 02:48:02 +0200 | [diff] [blame] | 34 | |
Willy Tarreau | 0a6b1fd | 2010-11-14 14:23:22 +0100 | [diff] [blame^] | 35 | - dontlog if <acl> (front/back) |
| 36 | |
| 37 | - fix "PR--" flags when accessing stats |
| 38 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 39 | - pattern extraction is needed for ACLs and stickiness. It would work like |
| 40 | this : |
Willy Tarreau | baaee00 | 2006-06-26 02:48:02 +0200 | [diff] [blame] | 41 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 42 | acl <name> <pattern> [-i] <values>... |
Willy Tarreau | baaee00 | 2006-06-26 02:48:02 +0200 | [diff] [blame] | 43 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 44 | All ACL fetch method currently available would be transformed into pattern |
| 45 | extraction methods. That way we could stick on hdr(x-forwarded-for) or use |
| 46 | source 0.0.0.0 usesrc <pattern> (such as "hdr_ip(headername)"). Note that |
| 47 | ACLs sometimes need iterative matching/extraction. |
Willy Tarreau | baaee00 | 2006-06-26 02:48:02 +0200 | [diff] [blame] | 48 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 49 | - add support for complex pattern extraction rules : |
Willy Tarreau | baaee00 | 2006-06-26 02:48:02 +0200 | [diff] [blame] | 50 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 51 | pattern = <pattern_term> |
| 52 | | '{' pattern_expr '}' |
willy tarreau | 814cbc6 | 2006-05-13 13:00:29 +0200 | [diff] [blame] | 53 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 54 | pattern_expr = <pattern_term> [ <transform> ... ] |
willy tarreau | 814cbc6 | 2006-05-13 13:00:29 +0200 | [diff] [blame] | 55 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 56 | - support loading data sets from files |
| 57 | + present/not present (eg: netmasks) |
| 58 | - pattern conversion per prefixes. Eg: convert src IP to country. |
willy tarreau | 814cbc6 | 2006-05-13 13:00:29 +0200 | [diff] [blame] | 59 | |
Willy Tarreau | 0a6b1fd | 2010-11-14 14:23:22 +0100 | [diff] [blame^] | 60 | - add a last activity date for each server (req/resp) that will be |
| 61 | displayed in the stats. It will be useful with soft stop. |
| 62 | |
| 63 | - add the ability to only dump response errors to more easily detect |
| 64 | anomalies without being polluted with attacks in requests. |
| 65 | |
| 66 | - add an error ID in captures to ease new error detection for scripts. |
| 67 | |
| 68 | - automatically compute fullconn for backends : by default, set it to |
| 69 | 10% of the sum of the maxconn of all unique frontends which reference |
| 70 | it via use_backend, default_backend or that are in the same listen. |
| 71 | |
| 72 | - hash: rehash non-consistent hashes with chash() for more randomness. |
| 73 | |
| 74 | - what to do with data after a POST and how to detect some data were |
| 75 | received when responding ? In theory we should read everything because |
| 76 | the TCP stack does not notify us that the FIN was acked. In practice, |
| 77 | reading just before closing should be enough. Right now we simply read |
| 78 | whatever comes after the POST. |
| 79 | |
| 80 | - half-closed timeouts ? |
| 81 | |
| 82 | - add a flag in logs to indicate keep-alive requests ? |
willy tarreau | 814cbc6 | 2006-05-13 13:00:29 +0200 | [diff] [blame] | 83 | |
Willy Tarreau | 0a6b1fd | 2010-11-14 14:23:22 +0100 | [diff] [blame^] | 84 | - make it possible to condition a timeout on an ACL |
| 85 | |
| 86 | - forwardfor/originalto except with IPv6 |
| 87 | |
| 88 | - have a callback function which would be called after a server is selected, |
| 89 | for header post-processing. That would be mainly used to remove then add |
| 90 | the server's name or cookie in a header so that the server knows it. |
| 91 | |
| 92 | - remove lots of remaining Alert() calls or ensure that they forward to |
| 93 | send_log() after the fork. |
| 94 | |
| 95 | DONE: |
| 96 | * rename L4 acls as L6 ACLs when some content is involved |
| 97 | |
| 98 | * add new L4 ACL checks immediately after accept, before even allocating the |
| 99 | buffers ("connection {accept|reject|delay|freeze} {if|unless}"). |
| 100 | |
| 101 | * make new patterns available based on stickiness matching : |
| 102 | * number of entries in table for the matched pattern |
| 103 | * same after having increased the match counter |
| 104 | |
| 105 | * add support for concurrency match in tables |
| 106 | * just like stickiness, but counted per session (or request), increased |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 107 | on first match and decreased at end of request or connection. This |
| 108 | requires that the session has a list of matched terms that must be |
| 109 | released at the end. |
willy tarreau | 814cbc6 | 2006-05-13 13:00:29 +0200 | [diff] [blame] | 110 | |
Willy Tarreau | 0a6b1fd | 2010-11-14 14:23:22 +0100 | [diff] [blame^] | 111 | * http_req_first ACL |
| 112 | |
| 113 | * expirable cookies + "preserve" |
| 114 | |
| 115 | * ECV, LDAPv3 & MySQL checks |
| 116 | |
| 117 | * configurable check buffer size |
| 118 | |
| 119 | * stats + ON/OFF |
| 120 | |
| 121 | * halog: sort by URL |
| 122 | |
| 123 | * "PROXY" protocol |
| 124 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 125 | 1.6 (will probably change anyway) : |
| 126 | - wait on resource (mem, socket, server's conn, server's rate, ...) |
willy tarreau | 814cbc6 | 2006-05-13 13:00:29 +0200 | [diff] [blame] | 127 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 128 | - bandwidth limits |
willy tarreau | 814cbc6 | 2006-05-13 13:00:29 +0200 | [diff] [blame] | 129 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 130 | - create internal services and make stats, CLI, etc... part of that. |
Willy Tarreau | 1c47f85 | 2006-07-09 08:22:27 +0200 | [diff] [blame] | 131 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 132 | - use_server ... if ... |
| 133 | |
| 134 | - buddy servers to build defined lists of failovers. Detect loops during |
| 135 | the config check. |
| 136 | |
| 137 | server XXX buddy YYY |
| 138 | server YYY # may replace XXX when XXX fails |
| 139 | |
| 140 | - spare servers : servers which are used in LB only when a minimum farm |
| 141 | weight threshold is not satisfied anymore. Useful for inter-site LB with |
| 142 | local pref by default. |
| 143 | |
Willy Tarreau | 1c47f85 | 2006-07-09 08:22:27 +0200 | [diff] [blame] | 144 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 145 | Old, maybe obsolete points |
| 146 | - clarify licence by adding a 'MODULE_LICENCE("GPL")' or something equivalent. |
| 147 | |
| 148 | - 3 memory models : failsafe (prealloc), normal (current), optimal (alloc on |
| 149 | demand) |
| 150 | |
| 151 | - ability to assign a task priority based on L7 matching |
Willy Tarreau | 1c47f85 | 2006-07-09 08:22:27 +0200 | [diff] [blame] | 152 | |
Willy Tarreau | 21475e3 | 2010-05-23 08:46:08 +0200 | [diff] [blame] | 153 | - implement support for event-triggerred epoll() |
| 154 | |
| 155 | - verify if it would be worth implementing an epoll_ctl_batch() for Linux |
| 156 | |
| 157 | - option minservers XXX : activates some spare servers when active servers |
| 158 | are insufficient |
Willy Tarreau | 1c47f85 | 2006-07-09 08:22:27 +0200 | [diff] [blame] | 159 | |
| 160 | - new keyword 'check' : check http xxx, check smtp xxx, check ssl-hello |
| 161 | |