Commit Graph

269 Commits

Author SHA1 Message Date
Kristóf Tóth
c279b2517f Implement branching in SnapshotProvider 2018-07-19 16:54:11 +02:00
Kristóf Tóth
8e87025905 Implement git based fs snapshot provider 2018-07-19 16:54:07 +02:00
Kristóf Tóth
d5feba7076 Implement HMAC signatures of fsm_update broadcast messages 2018-07-16 14:31:52 +02:00
Kristóf Tóth
a79c68515b Remove controller stuff, tidy code based on pylint suggestions 2018-07-16 11:18:27 +02:00
Kristóf Tóth
4236a17b69 Include last trigger in fsm_update messages 2018-07-14 20:45:26 +02:00
Kristóf Tóth
d98ce58651 Add proper multikey support for EventHandlers with compatibility 2018-07-14 20:06:34 +02:00
Kristóf Tóth
b06472ad19 Reintroduce FSM update messages with minor changes 2018-07-12 15:20:35 +02:00
Kristóf Tóth
7a92d88b73 Refactor FSMBase to subclass transitions.Machine 2018-07-04 15:48:16 +02:00
Kristóf Tóth
708c920784 Move FSM handling logic to an event handler 2018-06-29 22:03:19 +02:00
Kristóf Tóth
83dd6ae836 Fix IdeEventHandler not working with arbitrary keys 2018-06-18 15:13:39 +02:00
Kristóf Tóth
d0667253c2 Harmonize code formatting style across project 2018-06-04 22:16:44 +02:00
Kristóf Tóth
afc84e1d1a Conciliate FileManager attribute names and formatting 2018-06-04 21:47:10 +02:00
Kristóf Tóth
92e9812776 Remove unnecessary additional_dirs IdeEH.__init__ argument 2018-06-04 21:20:36 +02:00
Kristóf Tóth
a743b01bcf Reduce line length to 120 2018-06-01 17:19:58 +02:00
Kristóf Tóth
e80cce00f3 Add sphinx API documentation 2018-06-01 16:20:20 +02:00
Kristóf Tóth
c0fb28c46c Stop LogMonitor on EventHandler.cleanup() in LogMonitoringEH 2018-06-01 15:15:07 +02:00
Kristóf Tóth
6f3db18146 Use power of LazyInitialise to replace CallbackMixin.__init__() 2018-06-01 14:21:32 +02:00
Kristóf Tóth
cebacb15e6 Use power of LazyInitialise to replace ObserverMixin.__init__() 2018-06-01 14:06:40 +02:00
Kristóf Tóth
9f3a3b501f Initialise supervisor xmlrpc client lazily to avoid globals 2018-06-01 14:01:32 +02:00
Kristóf Tóth
e98c41d3cf Comply new API style in TerminalEH 2018-05-31 14:08:29 +02:00
Kristóf Tóth
ea251ef474 Document LogMonitoringEventHandler 2018-05-31 14:03:11 +02:00
Kristóf Tóth
b68ceeb394 Rework LogMonitoringEH API to adhere new conventions 2018-05-31 13:53:11 +02:00
Kristóf Tóth
2e953ea098 Implement LogMonitorEH API 2018-05-30 15:21:36 +02:00
Kristóf Tóth
73f6c6635b Rename my bootiful threadlocalise.. SupervisorBaseMixin method 2018-05-30 14:07:40 +02:00
Kristóf Tóth
3bb97a6dcc Implement LogMonitoringEventHandler to manage a LogMonitor via API 2018-05-30 13:14:25 +02:00
Kristóf Tóth
28c16e1127 Rework log deletion – use log_tail arguments instead 2018-05-29 17:59:16 +02:00
Kristóf Tóth
4815b97200 Fix shared xmlrpc client raising HTTP errors in LogMonitor 2018-05-29 16:40:58 +02:00
Kristóf Tóth
780d6a9b3c Avoid pylint stupidity ¯\_(ツ)_/¯ 2018-05-29 16:40:58 +02:00
Kristóf Tóth
32e3c2860d Fix inotify event logs triggering themselves (infinite log recursion) 2018-05-29 16:40:58 +02:00
Kristóf Tóth
029f4a9eb2 Implement watchdog observer to watch the logs of a supervisor process 2018-05-29 16:40:58 +02:00
Kristóf Tóth
9723f98950 Rework ProcessManagingEH log API 2018-05-28 16:36:59 +02:00
Kristóf Tóth
1a93dad562 Separate log clearing from reading 2018-05-28 15:02:53 +02:00
Kristóf Tóth
44df95a434 Refactor supervisor logging logic to separate mixin 2018-05-28 14:32:11 +02:00
Kristóf Tóth
fd56f8ca63 Make it impossible for TerminalCommands commands to kill TFW 2018-05-26 22:48:28 +02:00
Kristóf Tóth
77fabf28f6 Fix TerminalCommands parsing unix-style arguments incorrectly 2018-05-26 22:39:27 +02:00
Kristóf Tóth
0038663bc6 Allow listening to inotify events in additional directories using IdeEH 2018-05-24 16:19:04 +02:00
Kristóf Tóth
6489e4452e Remove ambigous API for log reading (actions always reply with logs included) 2018-05-24 11:22:39 +02:00
Kristóf Tóth
bfd1efa9f9 Append deployment logs to every response of ProcessManagingEventHandler 2018-05-24 11:20:00 +02:00
Kristóf Tóth
06e17a6591 Raise comprehendable exception from webide when no files are present 2018-04-26 11:09:31 +02:00
Kristóf Tóth
8396c10a7b Rename TerminadoEventHandler 2018-04-26 10:13:02 +02:00
Kristóf Tóth
3b30b333e5 Rename webide -> ide 2018-04-20 17:33:06 +02:00
Kristóf Tóth
0b651abb7d Nicen some EventHandler API docstrings 2018-04-19 10:47:20 +02:00
Kristóf Tóth
b1592e8ebb Use new f-strings where possible 2018-04-19 09:21:41 +02:00
Kristóf Tóth
addd517ba7 Add a huge bunch of docstrings 2018-04-18 19:44:26 +02:00
Kristóf Tóth
690f9bb190 Move TriggerlessEventHandler logic to base class EventHandlerBase 2018-04-18 18:47:51 +02:00
Kristóf Tóth
c909317ca0 Make TerminalCommands alias nonexistent commands only 2018-04-18 16:22:01 +02:00
Kristóf Tóth
743fab366b Extract variable to silence retarded linter 2018-04-14 23:15:44 +02:00
Kristóf Tóth
a65d3127ba Refactor DirectoryMonitor managing code to a mixin 2018-04-14 23:00:43 +02:00
Kristóf Tóth
1c29b700c2 Move mixins and decorators to tfw module from tfw.components 2018-04-14 21:15:30 +02:00
Kristóf Tóth
e2bb126e6f Make simple not if condition more pythonic 2018-04-14 21:07:33 +02:00
Kristóf Tóth
586c435cc2 Refactor watchdog Observer handling to a mixin 2018-04-14 20:36:43 +02:00
Kristóf Tóth
ecec1cde59 Root out remaining ambiguous key arguments in EventHandlers 2018-04-14 10:45:23 +02:00
Kristóf Tóth
d04479157d Refactor ServerUplinkConnector.send() signature 2018-04-14 10:45:23 +02:00
Kristóf Tóth
b8cdb30318 Add missing legal boilerplate to terminal_commands.py 2018-04-14 10:44:54 +02:00
Kristóf Tóth
512a965328 Update old logging code to use TFW global logging 2018-04-13 16:46:11 +02:00
Kristóf Tóth
7877e977ab Extract magic dict building to method in TerminalCommands 2018-04-13 10:01:45 +02:00
Kristóf Tóth
16c1fe7b50 Implement appending command aliases to bashrc to avoid command not found 2018-04-12 11:07:56 +02:00
Kristóf Tóth
8caf879ffd Integrate terminal command magic class from test repo to TFW 2018-04-12 10:56:15 +02:00
Kristóf Tóth
1922050e87 Make semantics of whitelist and blacklist more explicit in webide 2018-04-07 15:00:31 +02:00
Kristóf Tóth
8bd6005b5d Refactor blacklisting into a method in webide 2018-04-07 14:35:42 +02:00
Kristóf Tóth
4a216d8875 Rename SourceCodeEventHandler to WebideEventHandler 2018-04-07 14:18:15 +02:00
Kristóf Tóth
0464acbdc4 Make error logs more explicit 2018-04-06 16:09:05 +02:00
Kristóf Tóth
1f2e1f0489 Refactor whole importing hell into a nice and clean API 2018-04-06 15:31:16 +02:00
Kristóf Tóth
bd84e4fe06 Improve code formatting in webide 2018-04-05 17:19:56 +02:00
Kristóf Tóth
bc340e2e19 Enforce webide whitelisting 2018-04-05 17:16:41 +02:00
Kristóf Tóth
b73b7307bd Improve webide whitelisting by enforcing stricter rules (fix symlink attack) 2018-04-05 17:01:50 +02:00
Kristóf Tóth
b74ff39438 Implement directory whitelisting in webide 2018-04-05 14:43:39 +02:00
Kristóf Tóth
35421649c9 Extract spawning bash as user to a variable 2018-04-05 14:43:07 +02:00
Kristóf Tóth
19f819c142 Implement TFW & challenge solver user separation 2018-04-04 17:43:18 +02:00
Kristóf Tóth
eaa0eee4ca Add LICENSE file and include copyright notice in source files 2018-04-03 14:49:14 +02:00
Kristóf Tóth
d850f55b86 Add pylint local excludes to silence false positives 2018-03-30 18:11:38 +02:00
Kristóf Tóth
3ae0995b95 Make project comply new coding standards and pylint 2018-03-30 17:50:20 +02:00
Kristóf Tóth
2087294510 Implement simple HistoryMonitor for GDB monitoring 2018-03-29 15:19:00 +02:00
Kristóf Tóth
ba41c0b505 Make initialization of historymonitor the responsibility of client 2018-03-29 11:34:08 +02:00
Kristóf Tóth
c973b17141 Refactor HistoryMonitor to be customisable 2018-03-29 11:23:38 +02:00
Kristóf Tóth
1982a3c869 Rename TFWENV and TAOENV constants to use capital letters 2018-03-25 16:38:39 +02:00
Kristóf Tóth
8eded8cbac Make use of format string optimization in logging calls 2018-03-25 16:38:32 +02:00
Kristóf Tóth
73ed680298 Fix bad indentation 2018-03-25 16:20:49 +02:00
Kristóf Tóth
aacdbcb0d1 Standardize log constant naming and declaration placement 2018-03-25 16:06:59 +02:00
Kristóf Tóth
1e2ea0ed17 Standardize imports: standard newline package newline tfw 2018-03-25 15:43:59 +02:00
Kristóf Tóth
095c818a36 Move @with_monitor_paused decoartor to directory_monitor.py 2018-03-21 17:18:16 +01:00
Kristóf Tóth
6e391b6b2c Rename watchdog's EventHandlers to avoid confusion 2018-03-20 14:35:21 +01:00
Kristóf Tóth
c8dca5f33b Change order of classes in directory_monitor.py 2018-03-20 14:32:27 +01:00
Kristóf Tóth
359e478069 Move DirectoryManagingEventHandler to seperate module 2018-03-20 14:29:14 +01:00
Kristóf Tóth
598cf6218a Remove duplicate name from logging 2018-03-20 12:20:13 +01:00
Kristóf Tóth
6c5361846b Adjust DirectoryMonitor rate limiting to filter multi-inotify events 2018-03-20 11:40:20 +01:00
Kristóf Tóth
b1f4842dc7 Use now fixed DirectoryMonitor.ignore property in webide 2018-03-20 11:39:37 +01:00
Kristóf Tóth
08693d3ba2 Fix infinite recursive property in DirectoryMonitor 2018-03-20 11:31:29 +01:00
Kristóf Tóth
222143665c Implement DirManagingEH selectdir API 2018-03-20 09:02:05 +01:00
Kristóf Tóth
7b834f8f25 Expose DirManagingEH.directory as a property 2018-03-20 09:02:05 +01:00
Kristóf Tóth
aaaad9c459 Add untested DirectoryMonitoringEventHandler implementation 2018-03-20 09:02:05 +01:00
Kristóf Tóth
cc87540171 Implement SourceCodeEventHandler blacklist manipulating API 2018-03-15 15:54:07 +01:00
Kristóf Tóth
aa54e40f14 Refactor SourceCodeEventHandler blacklisting to use unix pattern matching 2018-03-15 15:50:52 +01:00
Kristóf Tóth
1b87863997 Refactor FileManager.select_file() to @filename.setter property 2018-03-15 12:18:39 +01:00
Kristóf Tóth
0ef502a680 Make property setup stuff in FileManager.__init__() more readable 2018-03-15 12:04:39 +01:00
Kristóf Tóth
4b8b71d967 Expose FileManager exclude as a property 2018-03-15 12:02:56 +01:00
Kristóf Tóth
929ea905c5 Improve error handling in webide backend 2018-03-14 14:15:40 +01:00
Kristóf Tóth
b955a570fd Fix DirectoryMonitor.stop() raising unhandled KeyError on rm -rf workdir 2018-03-09 09:50:13 +01:00
Kristóf Tóth
0e4be3c22f Refactor DirectoryMonitor handling in SourceCodeEventHandler 2018-03-09 09:37:48 +01:00
Kristóf Tóth
3b241a3930 Implement error handling in SourceCodeEventHandler.select_dir() 2018-03-09 09:11:52 +01:00
Kristóf Tóth
20895cb989 Add workind directory to SourceCodeEventHandler's default fileinfos 2018-03-09 08:52:13 +01:00
Kristóf Tóth
9e4fe87d84 Implement support to change working directories in SourceCodeEventHandler 2018-03-09 08:45:30 +01:00
Kristóf Tóth
7858caf51a Make excluded stuff in FileManager configurable from __init__() 2018-03-09 08:41:12 +01:00
Kristóf Tóth
b224ed519d Add support to FileManager to change working directory 2018-03-09 08:37:08 +01:00
Kristóf Tóth
491bbe5df6 Remove ambiguous log (already logged in networking) 2018-03-08 16:41:43 +01:00
Kristóf Tóth
af1a6261cc Refactor naming conventions: data_json -> message in TFW EventHandlers 2018-03-08 16:11:43 +01:00
Kristóf Tóth
36724c5c51 Implement 'tail' on stderr feedback 2018-03-08 16:05:44 +01:00
Kristóf Tóth
f874deff6e Implement stderr feedback on deployment failure (ProcessManagingEventHandler) 2018-03-08 16:04:35 +01:00
Kristóf Tóth
8588328a8f Improve handling of supervisor errors in ProcessManagingEventHandler 2018-03-07 16:35:55 +01:00
Kristóf Tóth
9b550f724d Extend ProcessManagingEventHander with deployment failure detection 2018-03-07 15:14:33 +01:00
Kristóf Tóth
d11d9a70cb Remove TFW antipattern I wrote without thinking 2018-03-07 14:47:24 +01:00
Kristóf Tóth
2c816d5a38 Implement error handling on EventHandler exposing APIs 2018-03-07 14:45:43 +01:00
Kristóf Tóth
6a6236e704 Refactor callback subscription stuff to a mixin 2018-03-07 11:45:57 +01:00
Kristóf Tóth
6d59762e2b Clean up confusing usage of data_json['data'] in TerminadoEventHandler 2018-03-07 11:37:52 +01:00
Kristóf Tóth
cb7e8c5663 Make DirectoryMonitor.ignore setter more pythonic 2018-03-07 11:36:21 +01:00
Kristóf Tóth
3cf404ee9a Implement inotify event ignoration logic 2018-03-07 09:17:29 +01:00
Kristóf Tóth
1165fa4ec9 Refactor pty resetting logic to TerminadoMiniServer 2018-03-06 16:15:04 +01:00
Kristóf Tóth
e20a5dab23 Implement pty recovery 2018-03-06 14:33:01 +01:00
Kristóf Tóth
555d571112 Expose term_manager in TerminadoMiniServer as a property 2018-03-06 14:28:36 +01:00
Kristóf Tóth
021a122523 Stop HistoryMonitor in TerminadoEventHandler.cleanup() 2018-03-06 13:27:32 +01:00
Kristóf Tóth
02bc317009 Refactor CallbackEventHandler to be a PatternMatchingEventHandler 2018-03-06 13:27:32 +01:00
Kristóf Tóth
a4b07e549e Rename & expose as property TerminadoEventHandler.monitor 2018-03-06 13:27:32 +01:00
Kristóf Tóth
0a20cffa09 Implement callback subscription logic in HistoryMonitor 2018-03-06 13:27:32 +01:00
Kristóf Tóth
ab76e3d024 Store length of history list requested in every case 2018-03-06 13:27:32 +01:00
Kristóf Tóth
cc964fdf27 Strip newlines from stored history in HistoryMonitor 2018-03-06 13:27:32 +01:00
Kristóf Tóth
180cf41f85 Implement history reading API 2018-03-06 13:27:32 +01:00
Kristóf Tóth
5133806d33 Make Historymonitor.history a list instead of a deque (for slicing) 2018-03-06 13:27:32 +01:00
Kristóf Tóth
eea6a418a8 Start work on HistoryMonitor to read command history 2018-03-06 13:27:32 +01:00
Kristóf Tóth
6312e22117 Make TerminadoMiniServer compatible with an external IOLoop 2018-03-06 13:27:32 +01:00
Kristóf Tóth
4873bbf421 Implement simple pty writing API 2018-03-06 13:27:32 +01:00
Kristóf Tóth
c4c07a4c85 Add proof of concept for terminal pty writing 2018-03-06 13:27:32 +01:00
Kristóf Tóth
bddc10269b Replace UniqueTermManager with SingleTermManager to support pty manipulation 2018-03-06 13:27:32 +01:00
Kristóf Tóth
b7f9acd3b0 Expose pty reference from TerminadoMiniServer 2018-03-06 13:27:32 +01:00
Kristóf Tóth
cc2c6009dd Delegate ownership of terminado server to TerminadoEventHandler 2018-03-06 13:27:32 +01:00
Kristóf Tóth
207f984db1 Delete key instead of setting it to empty string value 2018-03-02 14:02:05 +01:00
Kristóf Tóth
3e06f5c196 Optimize write event responses by removing unused file content 2018-03-02 11:04:58 +01:00
Kristóf Tóth
715e39af0d Expose DirectoryMonitor instance from SourceCodeEventHandler 2018-03-02 10:23:10 +01:00
Kristóf Tóth
e451de2179 Implement DirectoryMonitor support in ProcessManagingEventHandler 2018-03-02 10:21:56 +01:00
Kristóf Tóth
e29b300925 Refactor ServerUplinkConnector to avoid passing redundant data 2018-02-28 15:57:44 +01:00
Kristóf Tóth
9eaced9f02 Remove unused __init__ attributes from pmgeh related classes 2018-02-27 16:51:10 +01:00
Kristóf Tóth
a6bbe6df55 Update SupervisorMixin users to support stateless API 2018-02-27 15:54:31 +01:00
Kristóf Tóth
789db7416d Refactor SupervisorMixin to be stateless 2018-02-27 15:54:10 +01:00
Kristóf Tóth
57bd2aec45 Implement uplink notifications in ProcessManagingEventHandler 2018-02-27 15:26:16 +01:00
Kristóf Tóth
b50a2e401f Update ProcessManagingEventHandler to support new architecture 2018-02-27 14:39:54 +01:00
Kristóf Tóth
3341e97ef6 Fix anchor->key refactor conflicts after rebase 2018-02-27 14:39:40 +01:00
Kristóf Tóth
387d07bc4a Remove SupervisorMixin from ProcessManagingEventHandler 2018-02-27 14:10:00 +01:00
Kristóf Tóth
3506f5abb4 Fix ProcessMonitor not being compatible with SupervisorMixin 2018-02-27 14:10:00 +01:00
Kristóf Tóth
69c998bfde Rename ProcessManager.__init__() arguments to be more specific 2018-02-27 14:10:00 +01:00
Kristóf Tóth
8d8b60d143 Refactor ProcessManagingEventHandler 2018-02-27 14:10:00 +01:00
Kristóf Tóth
a50a173f54 Implement ProcessManagingEventHandler 2018-02-27 14:10:00 +01:00