Sentence examples for intermediate file from inspiring English sources

All the spill files generated by one map task are eventually merged into one single partitioned and sorted intermediate file on the local disk of the map task.

While this eliminates client-server intermediate file transfers, it also creates 2 significant problems in communication overhead and Byzantine fault tolerance.

Each map task receives a file chunk as input, counts the number of words in it and outputs an intermediate file with "word n" pairs for each word found.

Each partition in this intermediate file is to be processed by one different reduce task, and is copied by the reduce task as soon as the partition becomes available.

Strand's map reduction aggregation methods take advantage of the parallelism constructs afforded by the MapReduce model while avoiding much of the overhead associated with intermediate file disk I/O, sorting, and inter-process communication between the master and worker processes located on different commodity hardware machines.

All file paths generated by tool connections are managed by COSMOS, automatically assigning intermediate file names.

This result shows that GiGi-MR performs better with applications that create large intermediate files.

This result shows us that VMR performs better with applications that create large intermediate files.

Considering these results, and taking into consideration the typical compute-intensive nature of VC applications, we can determine that MapReduce jobs with large intermediate files are more suited (than others with smaller intermediate files) for VC.

Therefore, N-Gram is helpful in assessing the performance of our system with applications with large intermediate files.

This can be attributed to the fact that the intermediate files are much larger than the input and output data.