kafka.consumer

KafkaMessageStream

class KafkaMessageStream[T] extends Iterable[T] with Iterable[T]

All calls to elements should produce the same thread-safe iterator? Should have a seperate thread that feeds messages into a blocking queue for processing.

Inherited
  1. Hide All
  2. Show all
  1. Iterable
  2. Iterable
  3. IterableLike
  4. Equals
  5. Traversable
  6. GenericTraversableTemplate
  7. TraversableLike
  8. TraversableOnce
  9. FilterMonadic
  10. HasNewBuilder
  11. AnyRef
  12. Any
Visibility
  1. Public
  2. All

Instance constructors

  1. new KafkaMessageStream(topic: String, queue: BlockingQueue[FetchedDataChunk], consumerTimeoutMs: Int, decoder: Decoder[T])

Type Members

  1. type Self = Iterable[T]

    attributes: protected
    definition classes: TraversableLike

Value Members

  1. def !=(arg0: AnyRef): Boolean

    attributes: final
    definition classes: AnyRef
  2. def !=(arg0: Any): Boolean

    o != arg0 is the same as !(o == (arg0)).

    o != arg0 is the same as !(o == (arg0)).

    arg0

    the object to compare against this object for dis-equality.

    returns

    false if the receiver object is equivalent to the argument; true otherwise.

    attributes: final
    definition classes: Any
  3. def ##(): Int

    attributes: final
    definition classes: AnyRef → Any
  4. def $asInstanceOf[T0](): T0

    attributes: final
    definition classes: AnyRef
  5. def $isInstanceOf[T0](): Boolean

    attributes: final
    definition classes: AnyRef
  6. def ++[B >: T, That](that: TraversableOnce[B])(implicit bf: CanBuildFrom[Iterable[T], B, That]): That

    definition classes: TraversableLike
  7. def /:[B](z: B)(op: (B, T) ⇒ B): B

    definition classes: TraversableOnce
  8. def :\[B](z: B)(op: (T, B) ⇒ B): B

    definition classes: TraversableOnce
  9. def ==(arg0: AnyRef): Boolean

    o == arg0 is the same as if (o eq null) arg0 eq null else o.equals(arg0).

    o == arg0 is the same as if (o eq null) arg0 eq null else o.equals(arg0).

    arg0

    the object to compare against this object for equality.

    returns

    true if the receiver object is equivalent to the argument; false otherwise.

    attributes: final
    definition classes: AnyRef
  10. def ==(arg0: Any): Boolean

    o == arg0 is the same as o.equals(arg0).

    o == arg0 is the same as o.equals(arg0).

    arg0

    the object to compare against this object for equality.

    returns

    true if the receiver object is equivalent to the argument; false otherwise.

    attributes: final
    definition classes: Any
  11. def addString(b: StringBuilder): StringBuilder

    definition classes: TraversableOnce
  12. def addString(b: StringBuilder, sep: String): StringBuilder

    definition classes: TraversableOnce
  13. def addString(b: StringBuilder, start: String, sep: String, end: String): StringBuilder

    definition classes: TraversableOnce
  14. def asInstanceOf[T0]: T0

    This method is used to cast the receiver object to be of type T0.

    This method is used to cast the receiver object to be of type T0.

    Note that the success of a cast at runtime is modulo Scala's erasure semantics. Therefore the expression1.asInstanceOf[String] will throw a ClassCastException at runtime, while the expressionList(1).asInstanceOf[List[String]] will not. In the latter example, because the type argument is erased as part of compilation it is not possible to check whether the contents of the list are of the requested typed.

    returns

    the receiver object.

    attributes: final
    definition classes: Any
  15. def canEqual(that: Any): Boolean

    definition classes: IterableLike → Equals
  16. def clone(): AnyRef

    This method creates and returns a copy of the receiver object.

    This method creates and returns a copy of the receiver object.

    The default implementation of the clone method is platform dependent.

    returns

    a copy of the receiver object.

    attributes: protected
    definition classes: AnyRef
  17. def collect[B, That](pf: PartialFunction[T, B])(implicit bf: CanBuildFrom[Iterable[T], B, That]): That

    definition classes: TraversableLike
  18. def companion: GenericCompanion[Iterable[A][A]]

    definition classes: Iterable → Traversable → GenericTraversableTemplate
  19. def copyToArray[B >: T](xs: Array[B], start: Int, len: Int): Unit

    definition classes: IterableLike → TraversableLike → TraversableOnce
  20. def copyToArray[B >: T](xs: Array[B]): Unit

    definition classes: TraversableOnce
  21. def copyToArray[B >: T](xs: Array[B], start: Int): Unit

    definition classes: TraversableOnce
  22. def copyToBuffer[B >: T](dest: Buffer[B]): Unit

    definition classes: TraversableOnce
  23. def count(p: (T) ⇒ Boolean): Int

    definition classes: TraversableOnce
  24. def drop(n: Int): Iterable[T]

    definition classes: TraversableLike
  25. def dropRight(n: Int): Iterable[T]

    definition classes: IterableLike
  26. def dropWhile(p: (T) ⇒ Boolean): Iterable[T]

    definition classes: TraversableLike
  27. def elements: Iterator[T]

    definition classes: IterableLike
      deprecated:
    1. use iterator' instead

  28. def eq(arg0: AnyRef): Boolean

    This method is used to test whether the argument (arg0) is a reference to the receiver object (this).

    This method is used to test whether the argument (arg0) is a reference to the receiver object (this).

    The eq method implements an [http://en.wikipedia.org/wiki/Equivalence_relation equivalence relation] on non-null instances of AnyRef: * It is reflexive: for any non-null instance x of type AnyRef, x.eq(x) returns true. * It is symmetric: for any non-null instances x and y of type AnyRef, x.eq(y) returns true if and only if y.eq(x) returns true. * It is transitive: for any non-null instances x, y, and z of type AnyRef if x.eq(y) returns true and y.eq(z) returns true, then x.eq(z) returns true.

    Additionally, the eq method has three other properties. * It is consistent: for any non-null instances x and y of type AnyRef, multiple invocations of x.eq(y) consistently returns true or consistently returns false. * For any non-null instance x of type AnyRef, x.eq(null) and null.eq(x) returns false. * null.eq(null) returns true.

    When overriding the equals or hashCode methods, it is important to ensure that their behavior is consistent with reference equality. Therefore, if two objects are references to each other (o1 eq o2), they should be equal to each other (o1 == o2) and they should hash to the same value (o1.hashCode == o2.hashCode).

    arg0

    the object to compare against this object for reference equality.

    returns

    true if the argument is a reference to the receiver object; false otherwise.

    attributes: final
    definition classes: AnyRef
  29. def equals(arg0: Any): Boolean

    This method is used to compare the receiver object (this) with the argument object (arg0) for equivalence.

    This method is used to compare the receiver object (this) with the argument object (arg0) for equivalence.

    The default implementations of this method is an [http://en.wikipedia.org/wiki/Equivalence_relation equivalence relation]: * It is reflexive: for any instance x of type Any, x.equals(x) should return true. * It is symmetric: for any instances x and y of type Any, x.equals(y) should return true if and only if y.equals(x) returns true. * It is transitive: for any instances x, y, and z of type AnyRef if x.equals(y) returns true and y.equals(z) returns true, then x.equals(z) should return true.

    If you override this method, you should verify that your implementation remains an equivalence relation. Additionally, when overriding this method it is often necessary to override hashCode to ensure that objects that are "equal" (o1.equals(o2) returns true) hash to the same scala.Int (o1.hashCode.equals(o2.hashCode)).

    arg0

    the object to compare against this object for equality.

    returns

    true if the receiver object is equivalent to the argument; false otherwise.

    definition classes: AnyRef → Any
  30. def exists(p: (T) ⇒ Boolean): Boolean

    definition classes: IterableLike → TraversableLike → TraversableOnce
  31. def filter(p: (T) ⇒ Boolean): Iterable[T]

    definition classes: TraversableLike
  32. def filterNot(p: (T) ⇒ Boolean): Iterable[T]

    definition classes: TraversableLike
  33. def finalize(): Unit

    This method is called by the garbage collector on the receiver object when garbage collection determines that there are no more references to the object.

    This method is called by the garbage collector on the receiver object when garbage collection determines that there are no more references to the object.

    The details of when and if the finalize method are invoked, as well as the interaction between finalizeand non-local returns and exceptions, are all platform dependent.

    attributes: protected
    definition classes: AnyRef
  34. def find(p: (T) ⇒ Boolean): Option[T]

    definition classes: IterableLike → TraversableLike → TraversableOnce
  35. def first: T

    definition classes: IterableLike
      deprecated:
    1. use head' instead

  36. def firstOption: Option[T]

    definition classes: IterableLike
      deprecated:
    1. use headOption' instead

  37. def flatMap[B, That](f: (T) ⇒ Traversable[B])(implicit bf: CanBuildFrom[Iterable[T], B, That]): That

    definition classes: TraversableLike → FilterMonadic
  38. def flatten[B](implicit asTraversable: (T) ⇒ Traversable[B]): Iterable[B]

    definition classes: GenericTraversableTemplate
  39. def foldLeft[B](z: B)(op: (B, T) ⇒ B): B

    definition classes: TraversableOnce
  40. def foldRight[B](z: B)(op: (T, B) ⇒ B): B

    definition classes: IterableLike → TraversableOnce
  41. def forall(p: (T) ⇒ Boolean): Boolean

    definition classes: IterableLike → TraversableLike → TraversableOnce
  42. def foreach[U](f: (T) ⇒ U): Unit

    definition classes: IterableLike → TraversableLike → TraversableOnce → FilterMonadic
  43. def genericBuilder[B]: Builder[B, Iterable[B]]

    definition classes: GenericTraversableTemplate
  44. def getClass(): java.lang.Class[_]

    Returns a representation that corresponds to the dynamic class of the receiver object.

    Returns a representation that corresponds to the dynamic class of the receiver object.

    The nature of the representation is platform dependent.

    returns

    a representation that corresponds to the dynamic class of the receiver object.

    attributes: final
    definition classes: AnyRef
  45. def groupBy[K](f: (T) ⇒ K): Map[K, Iterable[T]]

    definition classes: TraversableLike
  46. def grouped(size: Int): Iterator[Iterable[T]]

    definition classes: IterableLike
  47. def hasDefiniteSize: Boolean

    definition classes: TraversableLike → TraversableOnce
  48. def hashCode(): Int

    Returns a hash code value for the object.

    Returns a hash code value for the object.

    The default hashing algorithm is platform dependent.

    Note that it is allowed for two objects to have identical hash codes (o1.hashCode.equals(o2.hashCode)) yet not be equal (o1.equals(o2) returns false). A degenerate implementation could always return 0. However, it is required that if two objects are equal (o1.equals(o2) returns true) that they have identical hash codes (o1.hashCode.equals(o2.hashCode)). Therefore, when overriding this method, be sure to verify that the behavior is consistent with the equals method.

    returns

    the hash code value for the object.

    definition classes: AnyRef → Any
  49. def head: T

    definition classes: IterableLike → TraversableLike
  50. def headOption: Option[T]

    definition classes: TraversableLike
  51. def init: Iterable[T]

    definition classes: TraversableLike
  52. def isEmpty: Boolean

    definition classes: IterableLike → TraversableLike → TraversableOnce
  53. def isInstanceOf[T0]: Boolean

    This method is used to test whether the dynamic type of the receiver object is T0.

    This method is used to test whether the dynamic type of the receiver object is T0.

    Note that the test result of the test is modulo Scala's erasure semantics. Therefore the expression1.isInstanceOf[String] will return false, while the expression List(1).isInstanceOf[List[String]] will return true. In the latter example, because the type argument is erased as part of compilation it is not possible to check whether the contents of the list are of the requested typed.

    returns

    true if the receiver object is an instance of erasure of type T0; false otherwise.

    attributes: final
    definition classes: Any
  54. def isTraversableAgain: Boolean

    attributes: final
    definition classes: TraversableLike → TraversableOnce
  55. def iterator(): ConsumerIterator[T]

    Create an iterator over messages in the stream.

    Create an iterator over messages in the stream.

    definition classes: KafkaMessageStream → Iterable → IterableLike
  56. def last: T

    definition classes: TraversableLike
  57. def lastOption: Option[T]

    definition classes: TraversableLike
  58. def map[B, That](f: (T) ⇒ B)(implicit bf: CanBuildFrom[Iterable[T], B, That]): That

    definition classes: TraversableLike → FilterMonadic
  59. def max[B >: T](implicit cmp: Ordering[B]): T

    definition classes: TraversableOnce
  60. def min[B >: T](implicit cmp: Ordering[B]): T

    definition classes: TraversableOnce
  61. def mkString: String

    definition classes: TraversableOnce
  62. def mkString(sep: String): String

    definition classes: TraversableOnce
  63. def mkString(start: String, sep: String, end: String): String

    definition classes: TraversableOnce
  64. def ne(arg0: AnyRef): Boolean

    o.ne(arg0) is the same as !(o.eq(arg0)).

    o.ne(arg0) is the same as !(o.eq(arg0)).

    arg0

    the object to compare against this object for reference dis-equality.

    returns

    false if the argument is not a reference to the receiver object; true otherwise.

    attributes: final
    definition classes: AnyRef
  65. def newBuilder: Builder[T, Iterable[T]]

    attributes: protected[this]
    definition classes: GenericTraversableTemplate → HasNewBuilder
  66. def nonEmpty: Boolean

    definition classes: TraversableOnce
  67. def notify(): Unit

    Wakes up a single thread that is waiting on the receiver object's monitor.

    Wakes up a single thread that is waiting on the receiver object's monitor.

    attributes: final
    definition classes: AnyRef
  68. def notifyAll(): Unit

    Wakes up all threads that are waiting on the receiver object's monitor.

    Wakes up all threads that are waiting on the receiver object's monitor.

    attributes: final
    definition classes: AnyRef
  69. def partition(p: (T) ⇒ Boolean): (Iterable[T], Iterable[T])

    definition classes: TraversableLike
  70. def product[B >: T](implicit num: Numeric[B]): B

    definition classes: TraversableOnce
  71. def projection: IterableView[T, Iterable[T]]

    definition classes: IterableLike
      deprecated:
    1. use view' instead

  72. def reduceLeft[B >: T](op: (B, T) ⇒ B): B

    definition classes: TraversableOnce
  73. def reduceLeftOption[B >: T](op: (B, T) ⇒ B): Option[B]

    definition classes: TraversableOnce
  74. def reduceRight[B >: T](op: (T, B) ⇒ B): B

    definition classes: IterableLike → TraversableOnce
  75. def reduceRightOption[B >: T](op: (T, B) ⇒ B): Option[B]

    definition classes: TraversableOnce
  76. def repr: Iterable[T]

    definition classes: TraversableLike
  77. def reversed: List[T]

    attributes: protected[this]
    definition classes: TraversableOnce
  78. def sameElements[B >: T](that: Iterable[B]): Boolean

    definition classes: IterableLike
  79. def scanLeft[B, That](z: B)(op: (B, T) ⇒ B)(implicit bf: CanBuildFrom[Iterable[T], B, That]): That

    definition classes: TraversableLike
  80. def scanRight[B, That](z: B)(op: (T, B) ⇒ B)(implicit bf: CanBuildFrom[Iterable[T], B, That]): That

    definition classes: TraversableLike
  81. def size: Int

    definition classes: TraversableOnce
  82. def slice(from: Int, until: Int): Iterable[T]

    definition classes: IterableLike → TraversableLike
  83. def sliding[B >: T](size: Int, step: Int): Iterator[Iterable[T]]

    definition classes: IterableLike
  84. def sliding[B >: T](size: Int): Iterator[Iterable[T]]

    definition classes: IterableLike
  85. def span(p: (T) ⇒ Boolean): (Iterable[T], Iterable[T])

    definition classes: TraversableLike
  86. def splitAt(n: Int): (Iterable[T], Iterable[T])

    definition classes: TraversableLike
  87. def stringPrefix: String

    definition classes: TraversableLike
  88. def sum[B >: T](implicit num: Numeric[B]): B

    definition classes: TraversableOnce
  89. def synchronized[T0](arg0: T0): T0

    attributes: final
    definition classes: AnyRef
  90. def tail: Iterable[T]

    definition classes: TraversableLike
  91. def take(n: Int): Iterable[T]

    definition classes: IterableLike → TraversableLike
  92. def takeRight(n: Int): Iterable[T]

    definition classes: IterableLike
  93. def takeWhile(p: (T) ⇒ Boolean): Iterable[T]

    definition classes: IterableLike → TraversableLike
  94. def thisCollection: Iterable[T]

    attributes: protected[this]
    definition classes: IterableLike → TraversableLike
  95. def toArray[B >: T](implicit arg0: ClassManifest[B]): Array[B]

    definition classes: TraversableOnce
  96. def toBuffer[B >: T]: Buffer[B]

    definition classes: TraversableOnce
  97. def toCollection(repr: Iterable[T]): Iterable[T]

    attributes: protected[this]
    definition classes: IterableLike → TraversableLike
  98. def toIndexedSeq[B >: T]: IndexedSeq[B]

    definition classes: TraversableOnce
  99. def toIterable: Iterable[T]

    definition classes: IterableLike → TraversableOnce
  100. def toIterator: Iterator[T]

    definition classes: TraversableLike → TraversableOnce
  101. def toList: List[T]

    definition classes: TraversableOnce
  102. def toMap[T, U](implicit ev: <:<[T, (T, U)]): Map[T, U]

    definition classes: TraversableOnce
  103. def toSeq: Seq[T]

    definition classes: IterableLike → TraversableOnce
  104. def toSet[B >: T]: Set[B]

    definition classes: TraversableOnce
  105. def toStream: Stream[T]

    definition classes: IterableLike → TraversableLike → TraversableOnce
  106. def toString(): String

    Returns a string representation of the object.

    Returns a string representation of the object.

    The default representation is platform dependent.

    returns

    a string representation of the object.

    definition classes: TraversableLike → AnyRef → Any
  107. def toTraversable: Traversable[T]

    definition classes: TraversableLike → TraversableOnce
  108. val topic: String

  109. def transpose[B](implicit asTraversable: (T) ⇒ Traversable[B]): Iterable[Iterable[B]]

    definition classes: GenericTraversableTemplate
  110. def unzip[A1, A2](implicit asPair: (T) ⇒ (A1, A2)): (Iterable[A1], Iterable[A2])

    definition classes: GenericTraversableTemplate
  111. def view(from: Int, until: Int): IterableView[T, Iterable[T]]

    definition classes: IterableLike → TraversableLike
  112. def view: IterableView[T, Iterable[T]]

    definition classes: IterableLike → TraversableLike
  113. def wait(): Unit

    attributes: final
    definition classes: AnyRef
  114. def wait(arg0: Long, arg1: Int): Unit

    attributes: final
    definition classes: AnyRef
  115. def wait(arg0: Long): Unit

    attributes: final
    definition classes: AnyRef
  116. def withFilter(p: (T) ⇒ Boolean): FilterMonadic[T, Iterable[T]]

    definition classes: TraversableLike → FilterMonadic
  117. def zip[A1 >: T, B, That](that: Iterable[B])(implicit bf: CanBuildFrom[Iterable[T], (A1, B), That]): That

    definition classes: IterableLike
  118. def zipAll[B, A1 >: T, That](that: Iterable[B], thisElem: A1, thatElem: B)(implicit bf: CanBuildFrom[Iterable[T], (A1, B), That]): That

    definition classes: IterableLike
  119. def zipWithIndex[A1 >: T, That](implicit bf: CanBuildFrom[Iterable[T], (A1, Int), That]): That

    definition classes: IterableLike