Parallel-processing Questions
Ad
Parallel exection using OpenMP takes longer than serial execution in C?
The serial version takes less time than the parallel one. /*serial version*/ double start = omp_get_wtime(); for (i = 0; i <
Calculating sum using parallel programming
I want to add 1 to a number(0) for 10 billion times. i tried two approaches - use a single thread (main thread) to do the work.
Using MPI_Scatter and MPI_Gather to implement Master-Worker-Model
I have written a mpi program for an image processing filter. the main goal of this program is that a given filter is applied to an image file
Access MPI_User_function from underlying MPI_Op handle
I want to write my own scan function in mpi style which means i have to access the associative operation from mpi_op parameter. i can't really
OpenACC - Complex loop carried dependence of a->,c->,b-> prevents parallelization
I am using openacc to compare the execution time of a parallelized vs non-parallelized matrix multiplication operation on the cpu using pgi
How to wait until all child processes called by fork() complete?
I am forking a number of processes and i want to measure how long it takes to complete the whole task, that is when all processes forked are
How to make parallel processing work in Python?
I am trying to do parallel processing in python. i have a huge dataframe with more than 4m rows. so as a sample given below, i would
Prevent reading data multiple times using Dask
What can i do to prevent same file being read more then twice? for the background, i have below detail im trying to read list of
Running parallel execution of fuctions using Promise all
I have a requirement to execute several parallel functions first functions: database get operation ie find inventory
Python, input rows of pandas data frame, output rows of a different data frame. Run in parallel
I need some help starting running some parallel code in python. i do not think that for my problem i can share executable code but still you can
Ad
spacy with joblib library generates _pickle.PicklingError: Could not pickle the task to send it to the workers
I have a large list of sentences (~7 millions), and i want to extract the nouns from them. i used joblib
Why do the spawned child process in node fire close event even before getting executed?
I am building a tool that executes puppeteer scripts from a json file. the challenge here is to implement parallel processing for mimicking
[JavaScript]Is there any way to excute multiple functions in parallel?
I am trying to call multiple functions in parallel in javascript. is it possible? for example: i want to get the sum of numbers(0 to 100). first,
aiohttp over pycurl multi, since python has the gil, what benefits do i get by switching to aiohttp?
In the crawler i am working on. it makes requests using pycurl multi. what kind of efficiency improvement can i expect if i switch to
python multiprocessing, make instance per process and reuse it
I'm using pytesseract to do some ocr with a multiprocessing approach. the approach looks the following: tess_api =
How to organize a multiprocess application in Node.js?
The source code is as follows: const listener = new listener (); listener.start (); process.on ('sigterm', () => {
My child processes crash silently with no error message even I handle its exceptions
I wrote a program to crawl a website and because of amount of link that i have to crawl i use python multiprocessing. when my program starts
How to delegate script execution to different nodes in exasol?
I am trying to add a couple of million rows to a table in exasol one column is supposed have increasing integer values (1 - xmio). i can't get my
How to manage a task queue in python and run those tasks in parallel on several computers?
I am looking for a python library which permits to : manage a task queue, run tasks in parallel (on one or several computers), permits that a
Multiprocessing on a list being passed to a function
I have a function that processes one url at a time: def sanity(url): try: if 'media' in url[:10]: url =
Create different processes using a list of objects
I want to execute this function without having to rewrite all the code for each process. def executenode(node):
Ad
how to use parallelize two serial for loops such that the work of the two for loops are distributed over the thread
I have written the below code to parallelize two 'for' loops. #include <iostream> #include <omp.h> #define size 100
Using Only One ForEach Loop
Please see the following code:- private sub picturebox1_paint(sender as object, e as painteventargs) handles picturebox1.paint
How to load and execute processes *in order* in python?
Is there any map-like method which doesn't load all sub-processes in memory at once, instead, if total cpu threads is four, it firstly load four
Multiprocessing so slow
I have a function that does the following : take a file as input and does basic cleaning. extract the required items
Parallelize sorting algorithm using pyspark
Good morning, i have developed a simple merge-sort algorithm which i want to compare its performance when it is parallelized and not
Blockwise decomposition array using C and MPI
Hi everyone i need to understand how to decompose an array to assign sub-blocks to a fixed number of processors. the case where the remainder
RequestsLibrary support parallel execute suites with pabot?
My project using requestslibrary to do
RxJava2 Parallel Download
Hi i am trying to download files parallely using rxjava2 but some how it is not working my code below: private
How to use parallel() of Highland.js in stream programming to achieve parallelisation?
I am trying to achieve parallelization of streams in nodejs, following code terminates on adding parallel method in the pipeline.
Multiprocessing slower than serial processing in Windows (but not in Linux)
I'm trying to parallelize a for loop to speed-up my code, since the loop processing operations are all independent. following online
How to speed up two nested for loops in big dataset
I am working on a 600.000 x 128 dataset, arranged in the following form with a hierarchical index (see left):
Ad
parallelize function which has multiple inputs
I would like to excecute a function multiple times on different threads with different function inputs. the problem is, that my function
node wait for iteration to complete before callback
I have a lambda function in node.js to send a push notification. in that function i need to iterate through my users sending a
Rust crossbeam borrow mutable in a loop
I try to process an array with multiple worker threads, just like rayon's par_iter() function, but i want to have a mutable reference
Promise parallelism and CPU
I need to clarify something about node.js, promises, cpu and performance. to set up a context, i will talk about an asynchronous
Difference in parallel processing between java and python
I make parallel processing program using java.util.concurrent.forkjoinpool. while proceeding this program, i checked top and
Why is parallel programing through multiprocessing library taking longer than usual programming?
Edit: i changed the cubic function and defined instead the actual optimization problem in which i noticed this issues. i also
parallel/multithread differential evolution in python
I'm trying to model a biochemical process, and i structured my question as an optimization problem, that i solve using
Multiprocessing in Python using Pool
I want to parallelize a function on a dataframe using python. i saw tutorials and i found some code.i have adjusted it to my needs. when i execute
java generated parallel IntStream(and other stream) issues
Public static void main(string[] args) throws throwable { atomicinteger i = new atomicinteger(); intstream .generate(
Why are memory fences required in Petersons Algorithm
Bool in_critical[2] = {false,false}; int turn; enter(int me, int other) { (s1:) in_critical[me]
Batch processing of large number of data set Laravel
I currently have a cron in laravel which takes data in chunk and call an api. the flow is below 1. cron runs every 5
Ad
How to use OpenMP with PARI/GP?
I want to parallelize a for loop that includes some operations from pari/gp library, along with some other operations. however, using openmp with
MPI_Get doesn't send the correct elements between the buffers of two process
I am trying to create a program that will ultimately be transposing a matrix in mpi so that it can be used in further computations. but right now
Proper way to compute time in openmp
I wrote a serial and parallel code for matrix multiplication and i compute the time in the serial code and got 4 seconds. however, in the parallel
Parallelization of a reverse-lookup with OpenMP
I'm trying to find the closest correlated color temperature to any arbitrary chromaticity. that is, for any (x, y) point in the following graph,
Parallelizing recursion in a for-loop using readdir
I'd like to parallelize a c-program which recursively calculates the size of a directory and its sub-directories, using openmp and c. my
OpenMP with Game of Life visualization using SFML
Hello i'm trying to compare speeds between serial and parallel version of 'game of life'. i used sfml library to visualize game of life like this.
Multithreading in C with CLion (Windows)
I have a section of code which is really time-consuming (~2s), and can be executed without the last one have finished.
Parallel Bubble Sort is blocked
My openmp program blocks on the first "for" loop of the following code, without any apparent reason. i'm simply trying to parallelize a bubble
Adding two arrays in parallel
I am fairly new to parallel programming; i am developing a program that deals with numbers in different bases and i want to parallelize the
Not able to automatically parallelize for loop with numba
I am trying to run the following on multiple cores for speed up using numba. unfortunately the function seems to run only on one core when i
Is there any way to write a for loop in python which will grab images from camera and save it parallelly?
I'm using a basler camera to take images and also using pypylon to interface camera software(pylon) with python i want to create two
Ad
Are 'j'-expressions in 'data.table' automatically parallelised?
How should i understand the parallelism built into data.table objects? from the getdtthreads function documentation, it
A3C on simulink model
I am currently running seperately my deep reinforcement learning algorithms on my simulink model. they are connected by a tcp/ip connection.
Can concurrent docker containers speed-up computations?
As a disclaimer let me just say that i am a beginner with docker and hence the question might sound a bit "dummy". i am exploring
Sorting arrays using OpenMP: why do some randomized arrays end up with long numbers and not sorted correctly?
Our assignment involves creating a sorting algorithm that sorts an array of randomly generated integers. the array size if set as an argument when
How to launch 100 workers in multiprocessing?
I am trying to use python to call my function, my_function() 100 times. since my_function takes a while to run, i want
Running command through sets of column names
I have a dataframe (merged_coin_plink) with columns of 181 rsid numbers such as (rs2807367_g) - (example just shown with two of them).
Multiprocessing with complex function
I want to create a multiprocess for a quite complex function in python: i have tested this function with a less complex code like this:
How to parallel 4 works with PARFOR with a Core i3 in Matlab
I have matlab r2012b for ubuntu 64 bits. i have a intel core i3 cpu m 330 @ 2.13ghz × 4. i want to use parfor to
java 8 parallel stream Issue
_logger.info("data size : "+saledata.size); saledata.parallelstream().foreach(data -> { saleaggrdata
Trying to know why the OpenMP code does not parallelise
I just started learning how to use openmp. i am trying to figure out
Why this code doesn't work in parallel python
I tried to use pp(parallel python) like this: import glob import subprocess import pp def run(cmd): print cmd
Ad
How to abort a Task like aborting a Thread (Thread.Abort method)?
We could abort a thread like this: thread thread = new thread(somemethod); . . . thread.abort();
Idea to speed up array processing
I want to create a dataset b by processing a dataset a. therefore, every column in a (~ 2 mio.) has to be processed in a
Replace nested for loops with parallel stream - Java
I'm working on improving the speed of a program where performance is critical. currently it fails to process large data sets. there are many
Selenium Grid Parallel Test Is Not Work Parallel
Hello i have two node which names are node1 and node2 and i do this tests in one computer. my problem is
Parallel file writing is it efficient?
I would like to know if parallel file writing is efficient. indeed, a hard disk has one usable read head at a time. thus the hdd can to do one
can I use async.waterfall inside async.parallel?
I want to call two functions and get the results in parallel but one of the function's results needed to be adapted. so the function structure is:
async parallel of API call with callback in node.js
I need to wait for tasks of two api callback functions and when tasks are done i would like to receive a callback so i can use data from both functions. i would
Ad
Blog Categories
Ad