splitter

package
v0.0.0-...-fdc5db8 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Mar 16, 2017 License: MIT Imports: 10 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

Functions

This section is empty.

Types

type CSVProcessor

type CSVProcessor interface {
	Process(r io.Reader, event *event.FileUploaded, startTime time.Time, datasetID string)
}

CSVProcessor defines the CSVProcessor interface.

type DatasetSplitEvent

type DatasetSplitEvent struct {
	DatasetID string `json:"datasetID"`
	TotalRows int    `json:"totalRows"`
	SplitTime int64  `json:"lastUpdate"`
}

type Processor

type Processor struct{}

Processor implementation of the CSVProcessor interface.

func NewCSVProcessor

func NewCSVProcessor() *Processor

NewCSVProcessor create a new Processor.

func (*Processor) Process

func (p *Processor) Process(r io.Reader, event *event.FileUploaded, startTime time.Time, datasetID string)

type RowMessage

type RowMessage struct {
	Index     int    `json:"index"`
	Row       string `json:"row"`
	StartTime int64  `json:"startTime"`
	DatasetID string `json:"datasetID"`
	S3URL     string `json:"s3URL"`
	RowID     string `json:"rowID"`
}

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
⌂ 换网址