FileTokenizer (JHOVE - JSTOR/Harvard Object Validation Environment 1.16.0 API)

java.lang.Object
- edu.harvard.hul.ois.jhove.module.pdf.Tokenizer
- - edu.harvard.hul.ois.jhove.module.pdf.FileTokenizer

```
public class FileTokenizer
extends Tokenizer
```
Tokenizer subclass which gets data from a RandomAccessFile.

Author:

Gary McGath

Field Summary
- Fields inherited from class edu.harvard.hul.ois.jhove.module.pdf.Tokenizer
  _ch, _file, PDFDOCENCODING

Constructor Summary

Constructors
Constructor and Description

FileTokenizer(RandomAccessFile file)

Constructors
Constructor and Description
`FileTokenizer(RandomAccessFile file)`

Method Summary

All Methods Instance Methods Concrete Methods
Modifier and Type	Method and Description
`void`	`backupChar()` Back up a byte so it will be read again.
`long`	`getFilePos()` Gets the current position in the file.
`protected void`	`initStream(Stream token)` Streams can occur only in files, not in streams, so some of the initialization of a stream object goes here.
`int`	`readChar()` Gets a character from the file, using a buffer.
`void`	`seek(long offset)` Set the Tokenizer to a new position in the file.
`protected void`	`setStreamOffset(Stream token)` Sets the offset of a Stream to the current file position.

Methods inherited from class edu.harvard.hul.ois.jhove.module.pdf.Tokenizer
addLanguageCode, getLanguageCodes, getNext, getNext, getOffset, getPDFACompliant, getWSString, readChar1, scanMode, seekReset, setEncrypted, setPDFACompliant

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Constructor Detail
  - FileTokenizer
```
public FileTokenizer(RandomAccessFile file)
```
- Method Detail
  - getFilePos
```
public long getFilePos()
                throws IOException
```
    Gets the current position in the file. This method is aware of buffering.
    
    Throws:
    
    IOException
  - readChar
```
public int readChar()
             throws IOException
```
    Gets a character from the file, using a buffer.
    
    Specified by:
    
    readChar in class Tokenizer
    
    Throws:
    
    IOException
  - seek
```
public void seek(long offset)
          throws IOException
```
    Set the Tokenizer to a new position in the file.
    
    Specified by:
    
    seek in class Tokenizer
    
    Parameters:
    
    offset - The offset in bytes from the start of the file.
    
    Throws:
    
    IOException
  - backupChar
```
public void backupChar()
```
    Back up a byte so it will be read again.
    
    Specified by:
    
    backupChar in class Tokenizer
  - initStream
```
protected void initStream(Stream token)
                   throws IOException
```
    Streams can occur only in files, not in streams, so some of the initialization of a stream object goes here.
    
    Specified by:
    
    initStream in class Tokenizer
    
    Throws:
    
    IOException
  - setStreamOffset
```
protected void setStreamOffset(Stream token)
                        throws IOException
```
    Sets the offset of a Stream to the current file position. Only the file-based tokenizer can do this, which is why this overrides the Tokenizer method.
    
    Specified by:
    
    setStreamOffset in class Tokenizer
    
    Throws:
    
    IOException

Class FileTokenizer

Field Summary

Fields inherited from class edu.harvard.hul.ois.jhove.module.pdf.Tokenizer

Constructor Summary

Method Summary

Methods inherited from class edu.harvard.hul.ois.jhove.module.pdf.Tokenizer

Methods inherited from class java.lang.Object

Constructor Detail

FileTokenizer

Method Detail

getFilePos

readChar

seek

backupChar

initStream

setStreamOffset