[Gambas-user] [Gambas Bug Tracker] Bug #1224: Add IPC shared memory between Main process and these forks (TASK)

[bugtracker at gambaswiki.org]

http://gambaswiki.org/bugtracker/edit?object=BUG.1224&from=L21haW4-

Comment #4 by Olivier CRUILLES:

Hi Benoit,

My problem is a little complex to solve. In fact due to an important volume of network data to proceed I need to use Task to scale all traitments and be able to not lose data because they are UDP flow comming.

So using TASK is possible to do what I want but I need to manage priority on TASK and for example when an big amount of network data flows quickly, all running tasks must change they priority to free cpu for the UDP socket server.

In this case, I need a bilateral communication between the main process and the Tasks AND I need a system like a big buffer (more than 16KB or 64KB) to sometime delay flow processing behind the UDP socket server. For this reason IPC could be a solution like Share memory because I can allocate up to 512MB and more of memory as buffer.

I have tried to use IPC message but it's not enough when the amount of flows is too big. I talk about more than 100000 Flow/s on 8 CPUs.
I work on this project about 1 year and a half and it is very important for me to finish it.

I don't know if in the end this is the best solution but in today I not able or I don't know how to do to manage efficiently something like a big buffer of communication between a Main process and Tasks.

If you have a concrete solution, I'm all listening it ? 

Thank you in advance.

Olivier

Olivier CRUILLES changed the state of the bug to: Accepted.