Questions tagged [batch-processing]

51 questions
0
votes
2 answers

Running supervisord process as root

My goal is to run sudo inside one of the programs: [program:doStaff] command=sudo python manage.py doStaff autostart=true autorestart=true stderr_logfile=/var/log/doStaff.err.log stdout_logfile=/var/log/doStaff.out.log Here is [unix_http_server]…
guystart
  • 1
  • 1
  • 1
0
votes
2 answers

Windows Job Scheduler

I'm looking for a Windows Server job/task scheduler for a small business. We need more functionality than the built in tools, including SQL Server Agent. We need conditional execution and would like the package to be able to handle holidays and…
None
0
votes
0 answers

Enterprise batch processing of application-generated emails

Here is what I perceive is our problem. In our corporate environment, we have developed over 40 custom .Net applications (and growing). A good many of these send email notifications in some fashion. A few of these send "real time" notifications --…
ironfist
  • 101
0
votes
1 answer

batch script to copy files as within SMB\CIFS protocol

I'm trying to copy files from remote machine using construction like this copy smb://DOMAIN;USERLOGIN:Password@100.10.10.10/folder/ C:/tmp/ it shows next message - The filename, directory name, or volume label syntax is incorrect. I guess that…
Olegdelone
  • 1
  • 1
  • 3
0
votes
1 answer

How to delay and queue commands for execution at a later time?

My site receives numerous uploads and I can't afford to waste cycles and time processing them on the spot (e.g., trimming, optimizing, resizing, etc.). What technologies exist to delay and queue these non-essential commands for execution at a later…
0
votes
2 answers

Moving files with batch files from one pc to a server, to a another pc - worried about disk corruption

I use scheduled tasks that calls a batch file, that calls more batch files to move about three files from a pc, to a server, then to multiple other pcs. It all happens very quickly, as they are small files. Are there any pitfalls for how fast these…
beauk
  • 13
  • 2
0
votes
1 answer

Distribute computing jobs across different machines?

I'm looking for a way to distribute computing jobs (mainly rasterization work) across multiple, idle machines on the network. The servers are running Debian 6 right now. Most of the work that needs to be done is standard command line work with some…
BastiBen
  • 131
  • 3
0
votes
1 answer

Batch Updates to Numerous Server 2008 Machines?

We run a lot of machines that are hosted in various datacenters (takes out the LAN based options) and we are finding the need to change Administrator account passwords for RDP (we use the same password for our admin account, just need to batch…
Aidan Knight
  • 650
  • 3
  • 11
  • 19
0
votes
2 answers

How to schedule batch file to run on the desktop in win 2008 R2

I have some backup batch file scripts which I was running in xp and I have migrated to windoes server 2008 R2 where it's not running in front when scheduled with task manager. I struggled a lot to make it run at the scheduled time with task manager…
0
votes
1 answer

Whats the best way to execute high processing tasks on low RAM VPS

I have one VPS on internet and that have only 768MB of RAM. Now i have run crawlers and various Optimzation algorithms /Data Mining Algos on the one mysql database. I think i need better computer for those tasks but i can't buy VPS for that as it…
Mirage
  • 541
  • 4
  • 10
  • 25
0
votes
1 answer

Only half of my pbs/Torque jobs are being scheduled

My supercomputing center recently moved from SGE to pbs/Torque. Now, when I schedule my array jobs, only half of the jobs in the array get scheduled. When they finish, the other half get scheduled. This happens despite the fact that they are largely…
vy32
  • 2,018
  • 1
  • 15
  • 20
0
votes
2 answers

Batch File Printing

I have a user that has to print out about 220 documents averaging 2-3 pages each. When printed using the standard Windows method of Select All - Right-click - Print it overwhelms either the print server or the printer itself. I am looking for a…
chrispt
  • 111
  • 2
0
votes
3 answers

Zip and FTP a File via a batch script

I am trying to ZIP and FTP a file in one batch file. The Zip part works, but the FTP application reads the entire batch script, rather than just the lines below the FTP commands, causing errors If these files are nor read sequentially, how do I Zip…
mmcglynn
  • 355
  • 2
  • 4
  • 14
0
votes
0 answers

Good technology for a large-scale batch operation on many S3 files in AWS Batch with Spot instances

I have an enormous corpus of text data stored in millions of files on S3. It's very common that I want to perform some operation on every one of those files, which uses only that file and creates a new file from it. Usually, I use my company's…
0
votes
0 answers

How to write a batch job query that has wait times, dependencies and conditional execution?

I'm trying to write a batch job that executes via task scheduler. The objective is to run these exe jobs sequentially. However, some of these jobs have dependencies on others. for eg. job1.exe (no dependencies. exe for an API call) job2.exe (no…