dsp::SerialFiles Class Reference

Loads serial BitSeries data from multiple files. More...

#include <SerialFiles.h>

Inheritance diagram for dsp::SerialFiles:

Public Member Functions
	SerialFiles (const char *name="SerialFiles")
	Constructor.
virtual	~SerialFiles ()
	Destructor.
const Input *	get_origin () const
	The origin is the current loader.
void	force_contiguity ()
	Treat the files as contiguous.
virtual void	have_open (const std::vector< std::string > &filenames)
	Makes sure only these filenames are open.
File *	get_loader ()
	Retrieve a pointer to the loader File instance.
const File *	get_loader () const
std::vector< Reference::To< File > > &	get_files ()
	Access to current file objects.
bool	has_loader ()
	Return true if the loader File instance is set.
virtual void	erase_files ()
	Erase the entire list of loadable files Resets the file pointers. More...
virtual void	erase_files (const std::vector< std::string > &erase_filenames)
	Erase just some of the list of loadable files Resets the file pointers regardless. More...
std::string	get_current_filename () const
	Find out which file is currently open;.
unsigned	get_index () const
	Find out the index of current file is.
uint64_t	get_next_sample ()
	Inquire the next sample to load for the current file.
void	add_extensions (Extensions *ext)
	Add any relevant extensions (calls loader's add_extensions())
Public Member Functions inherited from dsp::MultiFile
	MultiFile (const char *name="MultiFile")
	Constructor.
virtual	~MultiFile ()
	Destructor.
bool	is_valid (const char *filename) const
	Returns true if filename is an ASCII file listing valid filenames.
bool	validate_filenames (std::vector< std::string > &filenames, const char *metafile) const
	Return validated filenames loaded from metafile.
virtual void	open_file (const char *filename)
	Open the files listed in the provided ASCII file. More...
virtual void	open (const std::vector< std::string > &new_filenames)
	Open a number of files and treat them as one logical observation composed of multiple parallel streams. More...
const std::vector< std::string > &	get_filenames () const
	Get the names of the loaded files.
unsigned	nfiles ()
	Inquire the number of files.
Public Member Functions inherited from dsp::File
	File (const char *name)
	Constructor.
virtual	~File ()
	Destructor. More...
virtual void	open (const char *filename)
	Open the file.
void	open (const std::string &filename)
	Convenience interface to File::open (const char*)
virtual void	close ()
	Close the file.
virtual void	reopen ()
	Reopen the file.
std::string	get_filename () const
	Return the name of the file from which this instance was created.
std::string	get_current_filename () const
virtual std::string	get_data_filename () const
	For when the data file is not the current filename.
int	get_header_bytes () const
	Inquire how many bytes are in the header.
virtual bool	contiguous (const File *that) const
	Return true this this is contiguous with that.
Public Member Functions inherited from dsp::Seekable
	Seekable (const char *name)
	Constructor.
virtual	~Seekable ()
	Destructor. More...
virtual bool	eod () const
	Return true when end of data has been reached.
virtual void	rewind ()
	Rewind to the start of the data.
virtual uint64_t	get_current_sample ()
	Inquire current time sample.
void	set_output (BitSeries *data)
	Set the bits series into which data will be loaded.
void	set_overlap_buffer (BitSeries *)
	Buffer used to store overlap (useful in multi-threaded applications)
void	set_overlap_buffer_memory (Memory *memory)
	Set the memory type used in the overlap buffer.
Public Member Functions inherited from dsp::Input
	Input (const char *name)
	Constructor.
virtual	~Input ()
	Destructor.
virtual void	copy (const Input *input)
	Copies the behaviour and information attributes (not data) More...
void	prepare ()
	Prepare the output with the attributes of the data source.
void	reserve ()
	Reserve the maximum amount of output space required.
void	reserve (BitSeries *)
	Reserve the maximum amount of space required in the given container.
virtual void	restart ()
	Return to the start of data, if possible.
void	load (BitSeries *data)
	Load BitSeries data. More...
virtual BitSeries *	get_output ()
	Retrieve a pointer to the output. More...
virtual bool	has_output () const
	Return true if output is set.
virtual void	seek (int64_t offset, int whence=0)
	Seek to the specified time sample. More...
uint64_t	tell () const
	Return the first time sample to be read on the next call to operate.
virtual void	seek (const MJD &mjd)
	Seek to a sample close to the specified MJD.
virtual uint64_t	get_block_size () const
	Return the number of time samples to load on each load_block.
virtual void	set_block_size (uint64_t _size)
	Set the number of time samples to load on each load_block. More...
virtual uint64_t	get_overlap () const
	Return the number of time samples by which consecutive blocks overlap.
virtual void	set_overlap (uint64_t _overlap)
	Set the number of time samples by which consecutive blocks overlap.
virtual uint64_t	get_stride () const
	Convenience function for returning block_size-overlap.
virtual uint64_t	get_total_samples () const
	Return the total number of time samples available.
void	set_total_samples (uint64_t s)
	Set the total number of time samples available. More...
	operator const Observation * () const
	Get the information about the data source.
virtual Observation *	get_info ()
	Get the information about the data source.
virtual const Observation *	get_info () const
	Get the information about the data source.
uint64_t	get_load_sample () const
	Get the next time sample to be loaded.
uint64_t	get_load_size () const
	Get the number of samples to be loaded.
unsigned	get_resolution () const
	Get the time sample resolution of the data source.
void	set_resolution (unsigned res)
	Set the time sample resolution of the data source (use with care)
void	seek_seconds (double seconds, int whence=0)
	Convenience method used to seek in units of seconds.
double	tell_seconds () const
	Convenience method used to report the offset in seconds.
void	set_start_seconds (double seconds)
	Set the start of observation offset in units of seconds.
void	set_total_seconds (double seconds)
	Convenience method used to set the number of seconds.
void	set_context (ThreadContext *context)
	In multi-threaded programs, a mutual exclusion and a condition.
bool	has_context () const
	Return true if the thread context has been set.
virtual std::string	get_prefix () const
	Input derived types may specify a prefix to be added to output files.
Public Member Functions inherited from dsp::Operation
	Operation (const char *name)
	All sub-classes must specify a unique name. More...
	Operation (const Operation &)
	Copy constructor.
virtual	~Operation ()
	Virtual destructor.
virtual bool	operate ()
	Call this method to operate on data Returns false on failure. More...
virtual void	combine (const Operation *)
	Combine accumulated results with another operation. More...
virtual void	report () const
	Report operation statistics.
virtual void	reset ()
	Reset accumulated results to intial values. More...
std::string	get_name () const
	Return the unique name of this operation.
double	get_total_time () const
	Return the total time spent on this Operation in seconds.
double	get_elapsed_time () const
	Get the time spent in the last invocation of operate()
virtual uint64_t	get_total_weights () const
	Return the total number of timesample weights encountered. More...
virtual uint64_t	get_discarded_weights () const
	Return the number of invalid timesample weights encountered.
int	get_id ()
	Inquire the unique instantiation id.
virtual Function	get_function () const
	Get the function classification of this operation.
virtual double	get_delay_time () const
	Get the time delay of this operation, if any, in seconds.
virtual void	set_scratch (Scratch *)
	Set the scratch space.
bool	scratch_was_set () const
virtual uint64_t	bytes_storage () const
	The number of bytes of additional storage used by the operation.
virtual uint64_t	bytes_scratch () const
	The number of bytes of scratch space used by the operation. More...
Public Member Functions inherited from OwnStream
	OwnStream (const OwnStream &)
const OwnStream &	operator= (const OwnStream &)
virtual void	set_cout (std::ostream &) const
virtual void	set_cerr (std::ostream &) const
Public Member Functions inherited from Reference::Able
	Able (const Able &)
Able &	operator= (const Able &)
unsigned	get_reference_count () const
Public Member Functions inherited from Reference::HeapTracked
	HeapTracked (const HeapTracked &)
HeapTracked &	operator= (const HeapTracked &)
bool	__is_on_heap () const

Protected Member Functions
virtual int64_t	load_bytes (unsigned char *buffer, uint64_t bytes)
	Load bytes from file.
virtual int64_t	seek_bytes (uint64_t bytes)
	Adjust the file pointer.
void	init ()
	initialize variables
void	ensure_contiguity ()
	Ensure that files are contiguous.
Protected Member Functions inherited from dsp::File
virtual int64_t	fstat_file_ndat (uint64_t tailer_bytes=0)
	Return ndat given the file and header sizes, nchan, npol, and ndim. More...
virtual int64_t	pad_bytes (unsigned char *buffer, int64_t bytes)
	Over-ride this function to pad data via HoleyFile.
virtual int64_t	load_bytes_device (unsigned char *buffer, uint64_t bytes, void *device_handle)
	The file descriptor.
virtual void	set_total_samples ()
	Calculates the total number of samples in the file, based on its size.
virtual void	open_fd (const std::string &filename)
	Utility opens the file descriptor.
Protected Member Functions inherited from dsp::Seekable
virtual void	set_eod (bool _eod)
	set end_of_data
virtual void	load_data (BitSeries *data)
	Load next block of data into BitSeries.
virtual uint64_t	recycle_data (BitSeries *data)
	Conserve access to resources by re-using data already in BitSeries. More...
void	init ()
	initialize variables
Protected Member Functions inherited from dsp::Input
virtual void	operation ()
	Load data into the BitSeries specified with set_output. More...
virtual void	mark_output ()
	Mark the output BitSeries with sequence informatin.
Protected Member Functions inherited from dsp::Operation
virtual bool	can_operate ()
	Return false if the operation doesn't have enough data to proceed.
virtual void	set_name (const std::string &_name)
	Set the name!
int	timers_index (const std::string &op_name)
	Returns the index in the 'timers' array of a particular timer.
Protected Member Functions inherited from Reference::Able
Handle *	__reference (bool active) const
void	__dereference (bool auto_delete=true) const

Protected Attributes
Reference::To< File >	loader
	Currently open File instance.
std::string	current_filename
	Name of the currently opened file.
Protected Attributes inherited from dsp::MultiFile
std::vector< Reference::To< File > >	files
	List of files.
std::vector< std::string >	filenames
	Name of the currently opened file.
Protected Attributes inherited from dsp::File
int	fd
	The file descriptor.
int	header_bytes
	The size of the header in bytes.
std::string	current_filename
	The name of the currently opened file, set by open()
void *	host_buffer = nullptr
	staging buffer for Host to Device transfers
uint64_t	host_buffer_size = 0
	The size of the host_buffer in bytes.
Protected Attributes inherited from dsp::Seekable
bool	end_of_data
	end of data reached
uint64_t	current_sample
	Current time sample.
Reference::To< BitSeries >	overlap_buffer
	Buffer used to store overlap.
Protected Attributes inherited from dsp::Input
Reference::To< BitSeries >	output
	The BitSeries to which data will be loaded on next call to operate.
Reference::To< Observation >	info
	Information about the data source (passed on to BitSeries in load)
unsigned	resolution
	Time sample resolution of the data source. More...
uint64_t	last_load_ndat
	The ndat of the BitSeries last loaded Used by Seekable::recycle_data() and set by load()
std::string	real_source
	If not "" then the source of the output gets changed to this after loading [""].
Protected Attributes inherited from dsp::Operation
Scratch *	scratch
	Shared scratch space, if needed.
bool	set_scratch_called
std::string	name
	Operation name.
uint64_t	discarded_weights
	Number of time sample weights encountered that are flagged invalid.
uint64_t	total_weights
	Total number of time sample weights encountered.
RealTimer	optime
	Stop watch records the amount of time spent performing this operation.
int	id
	Unique instantiation id.
bool	prepared
	Set true when preparation optimizations are completed.

Additional Inherited Members
Public Types inherited from dsp::File
typedef Registry::List< File >	Register
	typedef used to simplify template syntax in File_registry.C
Public Types inherited from dsp::Input
typedef BitSeries	OutputType
Public Types inherited from dsp::Operation
enum	Function { Producer, Procedural, Structural }
	The function of the operator. More...
Static Public Member Functions inherited from dsp::File
static File *	create (const char *filename)
	Return a pointer to a new instance of the appropriate sub-class. More...
static File *	create (const std::string &filename)
	Convenience interface to File::create (const char*)
Static Public Member Functions inherited from Reference::Able
static size_t	get_instance_count ()
Static Public Member Functions inherited from Reference::HeapTracked
static void *	operator new (size_t size, void *ptr=0)
static void	operator delete (void *location, void *ptr)
static void	operator delete (void *location)
static size_t	get_heap_queue_size ()
Static Public Attributes inherited from dsp::Operation
static bool	record_time = false
	Global flag enables stopwatch to record the time spent operating. More...
static bool	report_time = true
	Global flag enables report of time spent in operation on descruction. More...
static bool	verbose = false
	Global verbosity flag.
static int	operation_status = 0
	Operations can set this to non-zero in operation() if they fail.
static bool	check_state = true
	Operations should perform internal consistency checks.
static int	instantiation_count = 0
	Counts how many Operation instantiations there have been Used for setting the unique instantiation ID. More...
Static Protected Member Functions inherited from dsp::File
static Register &	get_register ()
	Return the list of registered sub-classes.

Detailed Description

Loads serial BitSeries data from multiple files.

Member Function Documentation

erase_files() [1/2]

void dsp::SerialFiles::erase_files ( )

virtual

Erase the entire list of loadable files Resets the file pointers.

Erase the entire list of loadable files.

erase_files() [2/2]

void dsp::SerialFiles::erase_files ( const std::vector< std::string > &  erase_filenames )

virtual

Erase just some of the list of loadable files Resets the file pointers regardless.

Erase just some of the list of loadable files.

---

The documentation for this class was generated from the following files:

• SerialFiles.h
• SerialFiles.C