tornado - Should Celery sub-processes show up on ps aux | less -


i'm using supervisord celery on tornado server (note: not tcelery, since server isn't using async features yet) 3 workers: w1, w2, , w3. each has concurrency of 10. via supervisor adding following /etc/supervisord.conf:

[program:sendgrid_gateway_server] command=sudo python main.py -o runserver numprocs=1 directory=/home/ubuntu/sendgrid_gateway/sendgrid-gateway stdout_logfile=/home/ubuntu/sendgrid_gateway/sendgrid-gateway/logs/server_log.txt autostart=true autorestart=true user=root  [program:sendgrid_gateway_server_w1] command=celery worker -a tasks --loglevel=info --concurrency=10 -n w1 numprocs=1 directory=/home/ubuntu/sendgrid_gateway/sendgrid-gateway stdout_logfile=/home/ubuntu/sendgrid_gateway/sendgrid-gateway/logs/w1_log.txt autostart=true autorestart=true user=root  [program:sendgrid_gateway_server_w2] command=celery worker -a tasks --loglevel=info --concurrency=10 -n w2 numprocs=1 directory=/home/ubuntu/sendgrid_gateway/sendgrid-gateway stdout_logfile=/home/ubuntu/sendgrid_gateway/sendgrid-gateway/logs/w2_log.txt autostart=true autorestart=true user=root  [program:sendgrid_gateway_server_w3] command=celery worker -a tasks --loglevel=info --concurrency=10 -n w3 numprocs=1 directory=/home/ubuntu/sendgrid_gateway/sendgrid-gateway stdout_logfile=/home/ubuntu/sendgrid_gateway/sendgrid-gateway/logs/w3_log.txt autostart=true

the first [program] block main python application runs tornado. next 3 (obviously) celery workers. worries me when "supervisorctl start all" 30 processes show in list:

root 2547 0.0 0.0 40848 1672 ? s 13:40 0:00 sudo python main.py -o runserver root 2548 0.2 1.9 176140 33020 ? sl 13:40 0:04 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w3 root 2549 0.0 2.1 196848 35632 ? s 13:40 0:01 python main.py -o runserver root 2560 0.2 1.9 176140 33016 ? sl 13:40 0:03 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w2 root 2561 0.2 1.9 176140 33020 ? sl 13:40 0:03 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w1 root 2581 0.0 1.6 175144 28616 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w3 root 2582 0.0 1.6 175144 28624 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w3 root 2583 0.0 1.6 175144 28628 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w3 root 2584 0.0 1.6 175144 28628 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w3 root 2585 0.0 1.6 175144 28628 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w3 root 2586 0.0 1.6 175144 28632 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w3 root 2587 0.0 1.6 175144 28632 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w3 root 2589 0.0 1.6 175144 28636 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w3 root 2590 0.0 1.6 175144 28644 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w3 root 2591 0.0 1.6 175144 28640 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w3 root 2595 0.0 1.6 175144 28612 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w2 root 2596 0.0 1.6 175144 28624 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w1 root 2597 0.0 1.6 175144 28632 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w1 root 2598 0.0 1.6 175144 28620 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w2 root 2599 0.0 1.6 175144 28620 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w2 root 2600 0.0 1.6 175144 28620 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w2 root 2601 0.0 1.6 175144 28624 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w2 root 2602 0.0 1.6 175144 28636 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w1 root 2603 0.0 1.6 175144 28628 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w2 root 2604 0.0 1.6 175144 28636 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w1 root 2605 0.0 1.6 175144 28632 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w1 root 2608 0.0 1.6 175144 28632 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w1 root 2609 0.0 1.6 175144 28628 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w2 root 2610 0.0 1.6 175144 28640 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w1 root 2611 0.0 1.6 175144 28640 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w1 root 2612 0.0 1.6 175144 28632 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w2 root 2613 0.0 1.6 175144 28648 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w1 root 2614 0.0 1.6 175144 28644 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w1 root 2616 0.0 1.6 175144 28640 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w2 root 2617 0.0 1.6 175144 28636 ? s 13:40 0:00 /usr/bin/python /usr/local/bin/celery worker -a tasks --loglevel=info --concurrency=10 -n w2

those 30 celery processes, plus few (not quite sure why ones there...) under impression unnecessary processes should terminate after task has been finished. case or loony?

thanks in advance.

yes, should show processes. might want use stopasgroup=true , killasgroup=true options under program configurations stop child processes @ once, or else may keep running after have run stop [programname] command supervisorctl.


Comments

Post a Comment

Popular posts from this blog

curl - PHP fsockopen help required -

i trying work on cloudflare api , have found in documentation. unfortunately have no idea how can use in fsockopen or through curl. here example of post request. need know how can make request below data post using curl or fsockopen curl https://www.cloudflare.com/api_json.html -d 'a=cache_lvl' \ -d 'tkn=8afbe6dea02407989af4dd4c97bb6e25' \ -d 'email=sample@example.com' \ -d 'z=example.com' \ -d 'v=agg' here link cloudflare https://www.cloudflare.com/docs/client-api.html#s4.2 try one: $ch = curl_init("https://www.cloudflare.com/api_json.html"); curl_setopt($ch, curlopt_returntransfer,1); curl_setopt($ch, curlopt_followlocation, 1); curl_setopt($ch, curlopt_ssl_verifypeer,false); // handling of -d curl parameter here. $param = array( 'a' => 'cache_lvl', 'tkn' => '8afbe6dea02407989af4dd4c97bb6e25', 'email' => 'sample@example.com', 'z' =...
Read more

HTTP/1.0 407 Proxy Authentication Required PHP -

i working in restricted network/limited access internet. since have use proxy make web service call. here php code calling web service , response . $client = new soapclient("http: //www.xyz.com/abc/wsdls/login.wsdl", array("trace" => 1, "exceptions" => 1, 'proxy_host' => $proxy_host, 'proxy_port' => $proxy_port, 'proxy_login' => $proxy_login, 'proxy_password' => $proxy_password)); response is fatal error: uncaught soapfault exception: [wsdl] soap-error: parsing wsdl: couldn't load ' http://www.xyz.com/abc/wsdls/login.wsdl ' : failed load external entity if copy url error message , paste in browser(with same proxy settings) works. 2nd scenario is, if pass values instead of variables giving me diffarant response $client = new soapclient("http: //www.xyz.com/abc/wsdls/login.wsdl", array("trace" => 1, "exceptions" => 1, 'proxy_host' ...
Read more

c# - Resource not found error -

i have problem accessing method on homecontroller. show code of method : [httpget] public actionresult decriptidentifiantetredirige(string login_crypter, string mdp_crypter) { string loginacrypter = _globalmanager.protegemotdepasse(login_crypter); string mdpacrypter = _globalmanager.protegemotdepasse(mdp_crypter); user userapp = new models.user(login_crypter, mdp_crypter); if (userapp.authentificationvalidee(userapp.userlogin, userapp.password)) { session["name"] = userapp.userlogin; return redirecttoaction("accueil", "home"); } else { return redirecttoaction("validerauthentification", "home"); } } then in routeconfig.cs wrote route : routes.maproute( name: "authentificationapresdecryptage", url: "{controller}/{action}/{login_crypter}/{mdp_crypter}", defaults: new...
Read more